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ABSTRACT 


This  paper  considers  a  variety  of  matters  related  to 
formal  differentiation-   We  first  suggest  an  algebraic  approach 
to  formal  differentiation  of  a  class  of  set-theoretic  expressions. 
Then  we  go  on  to  discuss  the  application  of  formal  differentiation 
to  loop  fusion.   Finally  we  apply  formal  differentiation  to  optimization 
of  incremental  construction  of  composite  objects  satisfying  a  given 
predicate.   The  techniques  developed  are  illustrated  by  transformational 
construction  of  a  variety  of  algorithms. 
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1.        INTfiOCLCTION 

The  introduction  of  ve"/  h  1  qh  Le>/eL  Lany-ja  jes  sucr«  as  SETL  LDe] 
which  incluj?  ■; :?  t -t  i  eor  3  t  i  c  con-Jtructs  th^t  can  Lc;ai  to  computation  of 
rather  compLicateJ  s^^t  exnr^ssioni  has  created  ne<j  oopo  r  tun  i  t  i  es  for 
program  oc  t  i  m  iz  ^  t  i  on?  eioeciaLl/  oecajs?  =;Limin3tian  or  improw.'?!flent  of 
certair  basic  constructs  in  this  Langjag-^;*  such  as  s;?t  urioni  set 
construction?  iteration  ?tc.t  i  ■>  lik?Ly  to  have  a  significant  pay-off  in 
program    exacutioi    tin?    aid    ■itorai''    r?qji  r-^ments  « 

Cne  such  hiyh-LsweL  optimisation  technique  »  which*  foLlowInc  the 
termlnoLojy  of  Paije  dtJ  Schwartz  IP31»  we  wiLL  refer  to  as  'format 
c  i  f  f  er  ert  i  a  t  i  on' »  was  oriiinaLLy  proposed  by  S^arLey  C^aJj  who  called  It 
'it'^rator  inversion'.  This  techniqje       generalizes       the       classical 

'reduction  it  strsnglTT'  ■>  i  ti  n  i  z  i  t  i  on  t?:hniqu'=r  used  for  languaces  of  the 
FOFTRflN       leuelt       to       se t- t heo re t i c       exoressions.  Its      Qasic     icoa     is    to 

reolace  reneated  costly  comj  j!:  a  t  i  ons  of  set  thearetlc  expressions  whJse 
arquirents  change  only  sliihtly  iaetwesn  successive  computations  by 
computations  of  'incremental'  or  'differential*  expressions  which  are 
Less  expefisi^e  ta  ewalJate*  and  which  c  in  be  used  to  jpJate  the  i/alue  af 
the    origindl    expression. 

This  technique  has  Deen  studied  oy  "onq  and  Ulliian  CFUJt  iFo  ]  jnd 
by  Pdije  and  ScTwartf  !=»>]»  Z?  3  U  wno  (at  I  ■•  js  t  curreTtty)  regard  it  as 
a  technique  somewhat  too  soon  is t i cat ed  to  allow  automatic  treatment*  but 
one  which  is  systematic  enough  to  acimit  i  semi-automatic  i  mp  Lenen  ta  t  ion. 
(A    sketch    of    a    passial?    i  n  jl  eie  it  a  t  ion    js    descriaed    in   IPs]*) 

As  aeueloped  by  these  authors  formal-  differentiation  turns  out  to 
be  a  powerfjl  mecnaiisn  for  i  u^r  jve-aerit  Tf  i  very  h  i  ih  level  version  of 
an  alcorithm.  Its  application  C3n  produce  a  new  version  of  an  algorithm 
that  runs  an  order  of  majnicude  faster  than  its  original  versicr-.  These 
two  properties  of  formal  differentiation*  namely  that  on  one  hard  it  is 
capable  of  changing  the  asymptotic  oehavior  of  a Lgori t hms »  ard  on  the 
other  hand  that  it  is  nor^  r orn 1 I i z aole  and  systematic  than  many  other 
proqrafT  tr  ansformat  ion  methods*  makes  this  a  technique  c1  central 
research  interest.  ^in/  interestinq         examples  of  algoriihni 

transformation    or    fornal    differentiation    are     qiven    in   C^aJ. 

The  present  paper  contains  three  observations  concerniPi;  formal 
differentiation.  The    startini    point    of    our    first    oose'*vat  i  on  *    which    is 

cevelcped     in    section    2*     is    that    as    descrioed    till    now     (e.g.  ir       CPa])t 

formal  differentiation  tecnniques  remain  somewhat  less  methocical  than 
their  algebraic  counterjarts  jince  they  rely  on  larger  collections  of 
special  rules.  To  remedy  this*  we  will  suggest  a  relatively  simole 
formal  procedure  whicn*  thojjh  not  as  jeneral  as  Paije'j  rules*  is  more 
algebraic  in  flavor  and  can  handle  formal  differentiation  of  a  wica 
family  of  set  theorecic  expressions.  A  second  observation*  developeo  in 
section  <»  suq^ests  i  new  aoolication  it  formal  differentiation  to  looo 
fusior*  which  ace  om  oils  he  s  fijsion  essentially  by  inserting  one  loop  into 
another  and  then  avoiding  reoeatec  elaoorations  of  the  insertec  loop  by 
aoplying  formal  differentiation  to  the  expressions  computed  ir  it.  A 
thirc         ooservation*         developed  in         section         ^*       shows       hew       fcrmal 

differentiation  can  oe  jsed  t>  restrict  a-y  i  contraL  the  incremental 
cunstruction         of         com no site      objects      satisfying       a      given       predicate. 
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Existing  aao Licj t i on ;  of  formaL  differentiation  aim  at  ccnwerting 
reoeated  comuutatloi;  if  hiyi-leveL  s^t  ♦Theoretic  expressions  to  an 
increitert  jL  form;  in  section  4  we  wiLL  study  a  sicuation  -^here  a 
corrpcsite  object  3  i^  already  oeintj  constructed  i  ncrementa  LLy »  Cut  in  an 
inefficient  njamirt  ^id  ^id.<  t  3  »<  this  i  Tcr'?ni?nt  a  L  construction  can  oe 
sut s tan t i al Ly  improved  ny  analysis  of  certain  set-valued  expressions 
monitorin-j    the    i  Tcren^ntaL    construction    of    S,  ALL       th;se      ooservations 

are  illustrated  by  examoles*  including  a  systematic  derivation  using 
Iccp  fusion  techniques  of  (a  si^^nificant  oart  of)  an  efficient  garbage 
collection    al^orithfl    jj?    to    Oswar    and    .^s  Cann    COM]. 

The  notations  used  in  this  paoer  closely  follOM  those  of  the  SITTL 
programming  lanquaye  (cf.  LDalii  with  certain  deviatiois  to  enhance 
notational  succinctness.  For  t  h :;  sake  of  completeness  we  summarize 
these  notations:  Sit  union  is  written  as  a  *  a»  intersection  as  A  *  3» 
set  difference.-  as  A  -  9*  s/mmetric  difference  as  A  syir  B«  set 
coiTp  letten  t  at  i  on  as  Ac»  Cart-isian  product  a^  A  x  8t  set  membership  a«?  X 
in  A  (the  converse  r^LatiJn  is  denoted  as  'notin*)*  set  inclusion  as  A 
subset  0»  deterministic  selection  of  an  aroitrary  element  froii  a  set  as 
arb  A,  nondeterm  in  i  St  i  c  seU'ction  as  ar:i*  A»  the  null  set  as  C>»  the 
(multi-valued)  iiao  raij?  coistruct  as  FI  A]  (io  that  FL  ^1  is  the  range  of 
F  on  the  set  A)t  inverse  map  application  as  r-lCA]»  the  existential 
quantifier  as  'exists  <  st  P(X)'  or  as  'exists  X  in  A  st  P(X)»i  the 
universal  cuantifier  as  'forjll  X  ;  P(X)»  or  as  'foraLL  X  in  A  :  P(X)« 
anc  the  standard  Logical  connectives  as  'and't  'or't  'not**  'implies* 
etc.  Ue  abbreviat?  A  ••  CX}  as  \  -iith  X»  and  A  -  tX>  as  A  less  X. 
Tuples  are  denoted  usinj  square  oracketst  anii  compound  operators  are 
written    as    .op./    tupL?    of    arTumH?nts»    so    that    for    example    ♦/    CA(i)       t  i 

in  Cl...n]  ]  denotes  :?ummat  ion  '  of  A(l)  through  A(n).  Assicnment  is 
denoted  using  •:  =  •»  out  we  asore v'iaTte  »<  :=  X  .op.  Y»  as  'X  .cp.:=  IT*. 
Note  finally  tiat  linear  Tocation*  without  suoscripts  or  superscripts* 
is    usee     in    this    paper. 

I  would  lik?  to  jxarjsj  ny  -jratituie  to  Jacoo  ichwartz  for  his  h«lo 
in  preparing  this  manuscript*  to  Robert  Oewar  and  Elia  Ueixelbaum  for 
providing  a  derivation  of  the  garbage  collection  algorithm  discussed  in 
section  5  ana  for  stinulatiTi  discussions  concerning  that  alcorithiii»  to 
Robert  Paige  for  a  variety  af  illuminating  comments*  and  to  Fcith  Oeak 
and    Lamoert    Meertens    for    reviewing    this    paper. 


2.       A    SIMPLIFIED     TZZ-{'il2J 


0«    DIFFERENriATIMG    ZLT    THEORETIC    EXFREISSIONS 


In  this  section  we  fiicjs  our  atteTtion  on  the  oroolem  of 
regularizlrg  the  formal  differentiation  mechanism  descrioed  ir  CPa3  for 
the  c iff erent iat i on  of  certain  se t- theor et i c  expressions.  To  this  end» 
we  note  an  analojij'  ojtween  formal  di  f  f  erent  iat  ioa  ana  algeoraic 
differentiation*  and  taejin  with  the  following  observation:  Soth  in 
ordinary       and       in       se t -  the  or e t ic       fcrmal    differentiation    we    start    with    a 
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function  F(3)  of  an  drgum?nt  i»  whoS';  value  .at  a  particjlar  So  is  kno»<n« 
Suppose  that  we  change  S  'iLiqhtly*  to  a  new  value  ST  .od.  OS ;  how  can 
we  express  F( iO  •oi.  DS)  ai  a  c orrespoia in i  'ilijht  •  modification  af 
F(S0)3  Ir       aLgeDP3i       th-?       infix    operator    «op.       uilL    be    an    adcitiaPf    so 

that    we    can    writs 


F (SO    ♦    OS)     =    F(SO)     *    IF , 

which    iraplierj 

CF     =    F(SO    ♦    D3)     -    FCS) ) 

and    once    hhis    paint    ii    -eaciJl    >ie    can    p'oce^d    to    "jiaoLify    the    right-hand 
sice    ty    tne    standard    rules    of    alqebra    to    obtain    a    simpler    form    tor    CF. 

The  situation  is  similar  for  set-valued  expressions.  However*  as 
treated  oy  Paige  and  Schwartz.  th2  small  change  JS  and  the  corresponding 
cifterence  DF  are  aad^d  or  suotracted  from  the  sets  in  questiont  and 
since  in  the  set-theoretic  case  these  operations  do  not  have  an  inverse* 
we    arrive    at    an    equation    like 

F(SO    ♦    DS)     =     FtiD)    *■    OFt 


whose    solution    is    not    ojvious    and 
using    distrioutive    pr)jerti'?s    of 


Bust    somehow      oe       guessed*       aainly       by 


/s  simple  remedy  to  thii  prooLera  is  availaole  which  makes  use  of  the 
observation  that  th?rs  e'<i3ts  a  oinary  operation  on  sets*  namely  - 
symmetric  difference?  which*  taken  toQacher  with  set  intersection*  makes 
the  class  of  all  sets  into  a  ring.  If  one  takes  symmetric  citference 
(denoted  below  as  's^n*)  rather  than  union  or  -at  difference  as  the 
operation  by  which  S  and  F  ire  mocified*  then  one  is  aole  to  enpress  CF 
explicitly*    since    the    equation 


(  1) 


F(SC    sym    JS  )    =    F(SO)    i  yv    DF 


car  be  transformed  into 


(2) 


CF 


F(SO  sym  OS)  sym  r(S3) 


which    tnen    can    os    sin^lifiej    jsinj    standard    3 -tt -th?oret  ic       rules.  This 

approach  has  the  advantjg:.*  of  alLowini  any  set-valued  expression  to  be 
Q i f f er ent i ct ed  formally  (with  r?soect  to  any  change  DS  in  its  set 
argument       S)«  The       iJ»>tiJi       of       wheti?r       it    is    orofitable     to    do    so    is 

thereby  detached  from  the  actual  differentiation*  and  raecomes  a  matter 
of  how  much  (2)  can  be  simolified.  (In  the  worst  case*  where  (?)  can 
not  be  siiiplitied  at  all*  coinputation  of  F(33  syra  OS)  using  (1)  and  (2) 
will  be  roughly  three  tim^s  more  exnensive  than  a  direct  compL t 3 t ion. ) 
This  is  very  isefal  ii  en?  ij^iin  of  i  sen i-au toua t i c  transformation 
systeir*  since  it  allows  us  to  differentiate  expressions  formally  without 
having    to    verify    any    specific    enabling    condition. 


Simplification      of       (2)       can       of      course      be      performed         manually- 
However*      as       in      caljjlus*    ic     is    possiole    to    develop    a    set    of    rulei>    for 
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conBputatijr  of  •  Jeri  vat  i  v?s »  of  typical  set  expressicrst  and 
coitD  i  ra  t  i  ons  of  these  rules  can  then  oe  used  to  compute  derivatives  for 
a  Larier  class  af  ?x3" ? s;  i 3i i.   These  di f f ?r ?Tt i j t ion  rjles  inclJde; 

(3)    D(A  sym  B)  -  OA  s^ra  0H«; 

(^)         C(A    *    R)    =    A    *    DB    sym    il    *    CA    symDA    •    u3; 

(5)  D(A    ♦R)     =    D(A    i/tn    3    5yn    A    •    3)    = 

CA    sym    DB    sym    A    *    Ob    sym    B    •    DA    sym    OA    •    DB; 

(6)  DK    ~    f  >  t       if    <    15    iid?3JTd^nt    of    the    s^t    leincj    changed; 

(7)  GCAc)    -    0(U    sym    A)    -    :)U    sym    OA    =    t }    sym    DA    =    DA 

where    He    denotes    the    complement    of    Af    and    where    U    is    the 
uni  versal    sj  t ; 

(8)  0<A  X  1)  =  A  X  33  sym  :)A  x  Fi     sym  J  A  x  33; 

(S>    C(F-ICAJ)  =  F-i:OAJ 

(inverse  sinQle-vjlue J  map  application). 


Note  that  both  insertion  of  new  slaments  into  S  and  deletion  of  old 
elemerts  from  S  are  given  a  uniform  treatment  as  special  cases  of 
symmetric  differ?TC2. 

This  initial  set  of  rules  allows  us  to  differentiate  a  variety  of 
set  expressionst  in  oirticjldr  all  thuse  which  do  not  involve 
quantification  or  any  other  reference  to  elements  of  their  argument 
sets.  While  this  initial  family  of  d  i  f  f  eren  t  iab  le  expressions  is  s  !:  i  1 1 
too  limited  to  d?  jsaal?  in  all  3iinifi:ant  33S?s»  it  is  nevertheless 
interestin'5  to  see  a  few  examples  showinq  how  such  expressions  can  be 
different  iated  . 

Tc  this  end  we  assume  that  the  set  S  is  to  be  sli'^htly  sudifledt 
i.e.  replaced  by  5  srm  OS.  As  a  first  examplcf  let  Fli)  be  the 
set-former  expressioi 

(IC)   F(S)  =  CX  in  S  :  PCX )>, 

rJhere    P  (X  )    do(?s    not    d;3?nd    in    S.    This    can    oe    rewritten    as 


where    P*     denotes       the      truth-set       of      the      predicate      P.         Since       P»       is 
inaepenaent    of    ??»    we    obtain    imm-»diately 

CF    =    OS    »    P»    =    Cx    ii    OS    :    P(X)>    . 

ThuSf    a    program    fraqment    of    the    form 

(while    fX     IT    S    :     P(<)}     /=    c) 
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S    :=    S    sym    QS; 
end    whi  Le? 

can    te    t  ransf  oriii<?cJ    into 

FS   : =  f X   iT    s    :    p(x) }; 
(while    FS    /=    d) 

FS    :=  '^s   syii   cx    iT   IS    :   P(X)>; 

S    :-    S    sym    l)S  ; 
end    Mhi  Le ; 

in  a  st  ra  ight  f  or  JiPd  oarinsp.  '^ots  th^t  we  do  not  care  whethier  the 
chance  D(FS)  to  FS  is  incremental  or  dec remental •  Howeweri  in  this 
particular  car;e  0(F3)  can  oe  sho>4n  to  oe  of  the  same  kind  as  DS»  so  that 
wc  can  sudstitjt;  j?t  Jiijn  (or  sujtraction*  or  Dothi  for  the  •sym» 
operator  ir  both  assiinments  in  the  loop*  This  observation  is  of 
interest  because  in  somj  ^ors  compleK  cases  it  nay  only  be  possible  to 
formally  d if f erent i at  3  an  expression  (i.e.  oy  a  simplified  deriwatiwe) 
if    the    change    to    S    is    incremental    (or    decremental ) • 

As  a  slit>htLy  mo-»  lonoli^ated  sxamplet  consider  the  loLlowing 
expression*  which  could  Top.:?ar»  e.g.t  in  a  computation  of  the  transitive 
closure    of    a    s iny le-va Luei    map    -1 

(11)       G(S)    =    CX    in    S    :    F(X)    notin    S> 

This    can    be    rewrittsT    in 

G(S)    =    S    »    F-lCSc  : 
Applying    our    rules    we    obtain 

OG    =    OS    ♦    F-lIS:]    3/,Ti    S    *    0(F-lCS:J)    sym    JS    *    O(F-lCScJ) 

=    OS    *    F-1L3:]    sym    S    *    F-lCJSJ     sym    IS    •    F-lCDSJ 

To  giwe  a  somewhat  more  •real*  flavor  to  this  formulat  let  us  assume 
that  S  is  augmented  ay  a  single  element  U«  Then  the  Last  equation 
s  i  mp  I  i  f  ie  s    to 

DG     -    CU}     •     --lISc    -     {J>]    syu    S     »    --LCU} 

It  can  now  be  seen  that  the  first  oqerana  in  this  equation  Is  tc  he 
addeo  to  G»  rfiereai  t'le  inond  opirand  is  to  oe  sjotracted  from  G» 
After    a     few    more    simplifications*    we    arrive    at    the    following    ccce: 

G    :=    G    -    3    ♦    F-lCJl-  ; 

s    :=   s  with   u; 

if     F (U)     no t  in    S    then 

G    :  -    G    w  i  t  -I    J  ; 
ena    if; 


fis    a    third    example*    consider    the    program    fragment 
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(while    exists    X     in    J,    Y     in    S    st    ?(X,    Y)) 

s  H  i  th  :=   j; 

end    vihi  I  e  ; 

In  t:his  case  ^p    can  r?write  the  v^hiLe  statement  as 

(while  (S  X  S)  *  P«  /=  C>) 

which    invites    the    d i f f ?ps it i 3 t i an    of 

(12)       H(S)    =    (S    X    S)     »     ^» 

Usinc  the  preceding  rules*  we  odtdin 

CH  =  C(S  X  S)  »  P» 

=     (     OS    X    S    Si'fl    3    X    T3    syu    OS    x     03    )     *    r»« 

-    ({U>    X    S)    •    P»    sym    (3    x    CU})     »    P»    sym    (Cu>     x    Cu})     *    P» 

Acdin  it  is  easy  to  see  that  ill  operands  in  the  Last  equation  are    to  be 
^dded  to  H.   The  update  rule  for  H  j^ilL  then  simalify  to 

H    :=  H   ♦ 

CC'Jt    Y3    :     r     in    3    St    ?  (U,    Y)>    «■ 
CLX  ♦    J  ]    :    X    in    S    St    P(X,    u)}; 
it    P(U,     U)     then    H    :-    H    'M\th    CU.    U];    end    if; 


A  closer  Look  at  the  last  example  will  reveal  the  fcct  that 
maintenance  of  the  set  ■\  t  even  in  this  differential  manner»  may  be 
superfluous*  because  all  we  really  want  to  know  is  whether  H  is 
nonempty.  This  ooens  jp  the  issue  of  forinal  differentiation  of 
predicates  invol/inq  jlijitLy  ihanqin-j  set  a  r'^um^'nts .  'roper  treatirii-'nt 
of  this  i3sue  can  widen  the  class  or  formally  d if f erent iable  expressions 
cons  ideranlyi  and  with  the  addition  of  a  few  Tiare  rules  which  handle 
differentiation  of  expr'^ssions  involving  set  carainalityt  pcher  sets» 
function  spaces  etc.  we  can  come  to  rules  which  are  jratifyinjLy 
jene  ral « 

To  this  end»  Let  P(3)  denote  a  predicate  involving  some  set  Si  and 
assume  that  3  is  to  ti  chaoied  into  3  sym  03.  we  would  like  cocrpute  P(3 
sytt  CS)  using  the  valje  of  ^(3)  which  we  assume  that  we  alrecOy  have 
calculated.       To    do    30i     ^e    cai    write 

(12)       P(3    sym    OS)    =    P(S)    sy.Ti     OP     » 

where  we  extend  the  s^niietriu  difference  ooeracor  to  act  on  oooLean 
values  in  an  obvious  manner  (i.e.  P  sym  Q  is  true  iff  exactly  one  of  P 
anc    G    is    true).       Then    we    can    jrit,- 


(14)       CP 


P(S    s  yn    02)     syTi    ^(3) 


p/>GE   a 


and  again  f^ice  thf  prjr)L-?:n  jf  3  iiUD  L 1  f  y  inq  this  exuressicn-  For 
siiTplicity  Let  us  jssum»  that  tiie  onLy  operytors  appearinc  in  P  arn 
atenccrc       set       theoretic      oo^rjitors         such  a?         union»  inc  ersect  ion  t 

comq  Letnent  at  1  Tn»  lT:l.jsiin  ?tc»  Siric;  quntifi3rs  cai  oe  changed  into 
equalities  or  inequ-il  i  t  iei  in^ioLwinc  set  irjuments*  Me  assume  that  no 
quan t i f i Cdt ion    aQpears     in    P. 

It  toLlows  that  P(S)  can  Ce  representea  as  disjunction  and 
conjurction  of  primitivf  unics*  each  having  the  form  »A  -  {J»  or  its 
negation*    where    \    is    jan?    s;t-./alued    eicDression. 

To  c^rive  a  set  oi  rjL^s  for  format  Ji f f erent iat ion  of  predicates 
we  first  note  that  rjLe,  (  3>  -  (.7)  ext^Tl  eiiiL/  to  the  hooCean  c  a  se  t  to 
wit 

(15)  0(P    sym    Q)     =    3^    Sf-n    DJ ; 

(16)  C(P    and    Q)     =    (P    and    OQ)    sym    (Q    and    DP)    5yi»    (OP    and    DQ); 


(17)  C(P    or    a)    = 

DP    sym    OQ    sym    (?    and    OH)     sym    (Q    ano    D^)    sym    (JP    and    COi 

(18)  CR     -    false, 

wh?re    ?    is    i  id^-tendaT  t    of    the    set     ieiiq    charjjedi 

(IS)       C{not    P)    =    UP. 

These  rules  reduce  th^  problem  o i  c i f ter ent i a t in g  a  predicate  of  the 
form  just  considered  to  that  of  c  if  fer  ?nt  i  a  t  incj  a  predicate  having  the 
bas  i  c    form 

(2C)       P(S)    =    (F(S)    =    {>)     , 

where    FIS)     is    some    set-value  J    expression    depending    on    S. 

Usinj     (14),    W;?    can    <rit? 

(21)       CP    =    (F(S    sym    33)    =    O )     sym    IFiSt    -    {}) 

=     ((F    sym    UF)    =    C>)     sym     (F    -    O) 

=    (F    sym    OF    =    O        am       F    /=    f>)       or 
(F     =    O       and       -     ^/m    IF     /=     O) 

=    OF    /=    £>       and       (F    =    O       or      F    sym    DF    =    O) 

=    CF    /=    {}       aiJ       (^       or       F    -    OF ) 

As  it  stands*  th?  final  for-it  of  (Hi  dof?  3  noc  3lloi<  js  to  maintain  P(S) 
in  a  purely  d  i  f  f  er  en":  i  al  manner  oecause  we  may  have  to  raaintair  r(S)  as 
well  in  order  to  comcijte  auopredicate  (-  -  3r)»  BJt  there  is  a  case  in 
which  a  better  form  is  available.  Suppose  that  we  can  show  thct  F  =  DF 
only     if    F    =    {.>«       This    will    oe    the    case      cr«g«  if       3F       ic       knowr       to       be 

disjoint     from    F.       Thii     (21)     sinilifies    to 
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(  2C)        CF    =    (3       and       ( JF    /=    CI  )     ) 

so    that    by    (12) 

12Z)       PIS    sym     DS  )    =    ^(S)    i 


yn     (?(>)    and    (CF    /=    i} ) ) 
=    '(3)    anJ     (OF    =     £>) 


as  micht  be  expected.  This  formula  has  the  pleasant  property  that  when 
it    applies    F    need    not    oe    maintained    at    all;       only     its    deriv/atiwe    need    oe 

c  oiBPu  te  1  • 

Similar  formulae  can  b™  developed  for  oredicates  of  the  form 

(24)  Q(3)     =        (F(S)     /=     {>) 

Inaeedi  by  (19)«  DQ  =  O(not  J)f  so  that  we  can  use  (21)  to  coirfute  09. 
Again*     if    we    cai    shoj    tia^     F    -    Of   only    if    F   =    -Of    we    can    obtain 

(25)  G(S    sym    US)     =    Q(S)    or    (OF     '  =    C>) 

The  formulae  (23)  aid  (25)  jr3  ojrticularly  iseful  when  the  prc^d  ic.j  tes 
in  cuestion  control  a  loop  within  which  formal  differentiation  is 
desired.       For    ex^mpL?t    consider     the    case 

(while    F(S)    =    O) 

s  wi th:=  u; 
end    Mhi le? 

Here     the    predicate    P(3)    =    (F( S)  =    C>)     is    always    true    at    the    point       where 

we       want       to      differentiate    it.  Thus    if    IF 

that     CF    =    {}»     sothatwf-c  

{i). 


c     I  L.        I  nu-i    II     jr    -    r     at    that    point     it    follows 
an    .jse    (23)    to    deduce    that     P(3    sym    DS)    =    (Cr    = 


Let    us    now    r=tjri    ta    c> ts i ierat i on    of    (21)»    aut    no 


Let  us  now  r=tjri  to  c> ts i ierat i on  of  (21)»  out  now  assume  that  we 
are  unable  to  eliminate  tne  nondi  f  f  aren  t  ial  suopredicate  F  =■  Cr.  This 
being  so»  we  will  have  to  maintain  the  set  F  during  loop  execution 
(usi  r'J  formal  differentiation  if  possible)  ani.i  consequently  compute  P 
each    time     from    its    definition    (22)    without    using    (<ii)    at    all. 


be      mai  nta  ined  « 


/5s    an    inoortant     ?kj«-)1?     it    which    '^      will       h  i  we 
consicer    the    L  oop 

(wh  ile    F(S)    /=    C>  ) 

s  with:=  u; 

end    whi  Lei 

Since    we    want  to    d  i  f  f  ?  r  ?n  t  i  i  t  e    F    inside     the    looPt    we     know      thjt       at       the 

upcat^       point  F       /-    (.},       Ue    claim    that     in    this    case    the    equality    CF    =    F 

need    not     (and  in    general    will    not)     imol/    ^    -    C}»       so       tiat       we       can       lat 

rnaintsir       the  pr<;dicatrr      3(3)       =    (r(S)    /-    {>)     in    a    differenticl    manner. 

Inaeec»     if    we  had    Of    -    ^    only    if    F    -    {>♦     this    would    imply    by    (2-)t 
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Q(S  syra  CS )  =  Q  c:  )  or  i:j<=  /-  C>)  -  Qll)  -  true, 
which  impLies  th^t  trc?  Looo  aMI  n5\<er  termin-ate  since  the  test  in  the 
*whiLe'  stat;?iTieTt  wiLl  al-o/s  a?  true.  Henc?  !t  this  :as3  we  must  rjLLow 
tcr  the  possiJiLity  that  :^F  -  F  when  .-  /=  {}»  which  does  not  allow  us  to 
maintain  Q  a i f f erent i al L /.  (In  fact  this  jossioility  is  equivalent  to 
looo  terminatiOTj  anwijei  ti  i  t  the  Loop  is  not  oypasseJ«)  Consequently, 
wa  must  maintain  the  s?t  F  (hopefully  in  a  differential  merner)  and 
leave    the    'while*    condition    jnchanged. 

For  an  overall  demonstration  of  the  pow-r  of  our  formalisw  «  we  now 
consider  the  following  transitive  clasire  schema  (in  which  the  actual 
selection    of    the    Text    ;l3ueit     J    i  *;    not    shown); 

S  :-    S'  ', 

(while  exists  <  it  G  st  not  (FCX}  sjos^t  >)     ) 

S  with:=  u;      $  where  U  notin  S 
end  whi  le » 

Here  we  want  to  diff-»rentiate  the  predicate 

P(S)  =  exists  X  in  S  St  not  (F{X}  suDset  3) 

which  can  Pe  rewritten  as 

P(S)  =  exists  <  in  J.  r  ii  Sc  st  Y  in  -tX} 

-  exists  lX,  Y1  in  S  <  3c  3t  r  in  rCX> 

=  (S  x  Sc)  *    \*    /-    <.} 

where 

a«-{CX,Y3:YinFCX}}     (=-) 

Lf't  H(3)  -  (i  X  3c)  *  i;'.  TT?n  ^?  ha-J'i 

DH     -    (S    X    OS    sym    C3    x    ic    sym    US    x    OS)     •    A* 

---    (5    X    CD}     3<Ti    CJ>    X     "ii;     sy-n    ili}     x    CU>)     »     A* 

A3    noted    abovet    in    such    situations    H    must    be    maintained.       Thus    ^e    arrive 
at    the    following    for-nalL/    differentiated    version: 

S     J  -    S  0  » 

H     :-    {L  X  ,    Y]    :    X     in    S»     Y     in    Sc    st    Y     in    ~CX>>; 

(while    H    /=    C}) 

H    :=  H 

-    CCXt    U]     :     X    in    3     St    U     in    FCX}> 
£    suoset    o  f    H 

♦    ecu,    Y]    :     Y    in    (3c     Liss    U)    st     Y     in    FCU>}; 
i    c  i  s  j  0  int     from    H 

3   wi th :=   u; 
ena    while; 

iRcfA^'K:       70    Tbtairj    ti?     -^ell    known       •woP'?S!?t»       aljorithm       for       transitive 
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closure  from  the  abov?  v<»P3ion»  aLL  we  ha\/e  to  do  is  to  maintair  the  set 
RANGH    -    ran'je    H    iTst'?3J       if       H       itrs^Lf.  Th  1  .;       is       aosjioLs       since       the 

predicate  H  /=  C>  is  equivalent  to  the  predicate  RANoH  /-  C>.  The  main 
aifticulty      in      ace omo L is h in j       this       transformation       is       to      shew  that 

suDtracciJn  ri  f  the  first  ^  .•  t  fronj  H  has  t^i  ?  sa.Tie  eftect  as  suutractm^ 
{U>  from  its  r3n<je.  One?  this  is  provedj  we  can  elimindte  H  ana  so 
arrive    at    the     following    vi?r';ion 

s    :=  so; 

PANuh  :=  fr  :  X  in  St  r  in  Sc  3t  <  in  -cx}>; 
(while  RA.NGH  /=  C}) 

RAM'iH  :=  HAMGH  Lei?  U 

♦  CY  :  r  in  FC'Jl  St  Y  notin  (J  with  U)}; 

s  wi  th :=  u; 

end    while; 


which  is  precisely  th?  standard  workset  algorithrat  provided  that  one 
always  selects  D  frjB  the  c-jpf^ent  r<AN3H  s=?t.  The  cjecision  to  3-;Lact  U 
trcm    hANGH    is    quite    naturali     as    it    will    cause    the    removal    of    U    troni    that 


set 


and       so       'help*     it    co    diminish    to    the    null    set i    which    is    cur    goal. 


Th  is    obse  rva  t  i  ot 
fully     in    sect i on 


n3i    jsnerriL     ;i  3  nific  ante?    and    -^iLl 

4    oelow* 


ae      developed      more 


For  a  second*  m^-e  C3»3licat?d  3<ampLe»  consi^e'*  the  following 
prcbleii:  Given  a  set  £  and  a  subset  A  of  E  x  £»  find  the  smallest 
ffQuivialence  relation  5  on  £  which  contains  A.  This  proulen  can  be 
reforraulaced  as  follows  (<ri?re  f;  he  miiiTiality  coiJitian  is  tetnoorarily 
igrorec): 


find    S    a    suosat    of 
A    suoset    3    and 
(forall    X     in    L    :    CX* 
(forall    X    ii     :.    Y    IT 
(forall    X    in    t,    Y    in 
CX,     YJ    in    3 


X  1  such  that 


XI  in  S)  and 
£  :  CX»  f  ]  ii 
E»  2  in  c  : 
and  CY  ,  2  J  in  . 


implies  CY»  XJ  in  3)  and 
implies  CXt  Z]  ir  3) 


Usinc  a  standard  sche.-ne  for  the  construction  of  a  subset  of  a  civen  set 
subject  to  a  given  constraint  by  addini  to  it  one  element  at  a  time»  we 
ootain  the  fallDWinq  » i bd lene nt a t i on '  of  this  specification: 


s  :-  n; 

(while  not 


(A  ?  J  3  s:?  t 
(exists 
(exists 

CX, 

(ex  ists 

LX, 


■J )  or 
X  in  ;-  st  CX,  X]  notin  3)  or 
X  in  li     Y  in  £  st 
y:I  in  3  aid  CY»  XJ  notin  3)   3r 
X  inE»  Y  inEtZ  in£  st 
Y]  in  3  and  CY»  ZJ  in  S  and  CX,  Zl    notin  S)> 


sel--ct    U    :=    CVi 
s    J  i  t  h :  =  'J  ; 
ena    while; 


W  ]    nonde  t  "^rmin  i  st  i  cal  1/    st    U    notin    SJ 


N^xt    we    differentiate    the    axpressicn    appciaring 
To    do    so,    we    rewrite    chis    exor^ssion    as 


in 


the     'while'     statement. 
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fl  •  3c  /=  {>   or 

{CXt  X]  :  X  in  -.}  »  3':  /=  t}   or 

{LX»  y:  :  K  in  :,  X     ii  £  it 

CX,  n  in  S  and  CY,  XI  notin  3>  /=  O   or 
{ C  X  f  Y  t  Z  ]  :  X  t  Y  .  Z  i  n  L  5  t 

CX»  Y]  It  S  i-yi    lY»  Z]  in  S  aid  CX,  Zl    notin  i>  /=  {} 

This  can  ae  further  simoLified  as  folLoMs:  l?t  o  denote  the  set  -CtX*  X] 
:   X  in  t}»   Introdjc?  a  f'?^  nappinys  as  foLLows: 

I  (CX,  Y  ])  =  CY,  X]; 

F(cx ,  Y ,  z ])  =  :x ,  Y]; 
G(cx,  Y,  Zl)  =  :y«  z]; 

H(CX,  Y  ,  Zl)  =  CXt  Z3; 

Then     the    above    pr?d  ic  j  t:?    :  a -i    b^    rewritten    as 

A  *  Sc  /=  C}  or 
e  *  Sc  /-  C>  jr 
S    *    I-iCSc]    /=    t>      or 

F-icsa  •  's-icsj  •  H-i:3c]  /=  a 

dnc  better  stiLL  as 

(,a    •Sc    ♦"*3c+i*    I-lCoc]* 

F-lUSa    *    G-irSl    *    H-IC3C])    /=    o 

which  can  be  tomally  differentiated  tjsinj  the  rules  gi/en  above.  The 
simplest  procedure  is  to  differentiate  aach  set  expression  separateLy* 
Let  cs  cenote  the  four  set  exoressions  apoea'-inj  in  the  above  preaicate 
as    K(S)i    L(S).    M(S)»    M(3)     r ;  s  aec  t  i  vel /,       Then    wc    hai/;? 

CK     =    A     *    03 

CL     =    B    •     OS 

CM     -    S    *    I-1CD3]     s/1    33    •    I-1C3CJ    sym    OS    »    I-UDSJ 

CN    -    F-ICOS]    *    3-lL^3    *    H-iCSc]    sym 
F-1C3J    ♦    3-i:03]    *    H-IC3C]    sym 
F-1C31     »    3-i;SJ     •    H-ICC3]    sym 
F-ICOS]    •    3-lCrS]     •    H-lCSc]    sym 


F-ICO: 


•    3-lCS]    *    H-lCCS:    sym 


F-1LS3    *     3-i:03]    *    H-ICOS]    ^/m 
F-KD-JD     *    G-lCOSl     •    H-ICCSJ 

Since    OS    =    CJ}    =    CCVt    ^1}    sjiset    Sct    n?    can    sinolify    th2    above     to 

CK    =    ir    U    in    A    ti?n    {j}     »Ls-    i}    jid 

CL    =    if    U    in    3    then    C J >    el^a    {>    end 

CM    =    if    CWi    VJ    in    3    then    CCU»    si  1}     -"Lse     £}    end       sym 

if    C  <•  ♦    J  1    notin    5     ^hen     CCVi    Al}    else    C>    end      sym 
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U    -    V    tnen    CCV»    U]}    eLss    C>    end 


ON 


CL  V, 
CLX, 
CE  V, 

{£  y , 
a:  v» 


Vt 

r » 

V, 

l/« 


V] 


3  11 

X  iri 

r  in 

7  =    ^ 


£    3t 

•^    st 

£    St 

3  (id 


C  W  «    tJ  ]     in 
:  '^  t    t/  J    in 


ex, 

3> 


ZJ 
Y] 
;ym 


S>     j/m 


In  s  3Td  cv.   z: 

In  3  .^nd  CXt  U] 
in  S  and  Lit  Ml 
not  in    S>    syn 


notin  S>  sym 
notin  i>  syra 
in    S>    sym 


We  have  thus  con*/ertc*d  our  algorithm  into  one  ^hich  uses  four 
uifferent  worksets  ~3Ct\  af  fjhicn  requires  reLativeLy  LittLe  updating 
when    S     is    auqmented.       The    ns4    y/ersion    is    as    follows: 


s  :=  o; 

K  :=  a; 

L  :=  fl; 

M  ;=  {}; 

N  :-  c>; 

(while  K  /-  i}    or  L 

/- 

£}  or    -1  /  = 

select  J  :=  u  a  1 

4] 

3  3  O;;ror.»; 

K  :=  K  sym  DKJ 

L  :=  L  sym  3. ; 

M  :=  M  -syn  om; 

N  :-  N  sym  dm; 

s  wi  th :=  u; 

end  whi le 5 

{}    or    H    /=    t}) 


ion      still       hds       the       generality       of       the         original 

the    sense    that    all    S:?ts    iatistyiny    the    conditions    of 

<c?)t     f3-    Tii  ni  mau  i  t  ^  )  >    ind    Dnly    suct      sets      '<<  i  1 1      be 

(successful)        ?<ecutions      of    the    abov/e    nondet  crm  i  n  ist  ic 

h    imorove    the    way    in    which    U       is       selected       in 


This       new      wsrsion 
sceci1ication»       in 
the    spec i t ica t iD 1    (ecc?) 
const ructec       by 
prcgrair.       For    methods    whi 
the    precedinn    version*     >ei    ijction    4, 


LOOP    ruSIOiM    iJSI^3    F0-{1Al    di-fzremthtio?^ 


In  this  section  ms  describe  an  interesting  application  of  formal 
d  i  f  f  e  re  nt  ia  t  i  un  to  prossrom  construction.  This  technique*  which  has  bsen 
cdllec  loop  fusion*  is  dpolicaole  when  the  program  contains  two  or  more 
consecutive  lojos  wnsre  the  first  Idoo  >jil1s  jp  a  :ertain  composite 
object  which  is  used  in  the  s^cona  loop  to  build  up  another  composite 
object.  When  this  is  the  case*  we  may  ae  able  to  insert  the  second  loop 
into  the  first  ons  so  as  to  Tijke  the  sjcceedinq  copy  of  the  seccnd  loop 
recurcant*  and  then*  ap-jlying  formal  differentiation*  to  replace 
reoeated    executions    of     th?    inserted    Iood       by       iTcrementjl      computations* 
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resulting  in  an  ofrertive  fusion  of  th>i  two  Looos.  This  apqrosch  has 
the  advan'arje  of  oeinj  mors  I'^neral*  mor  ^  formal  an{j  more  systematic 
than       standarj       Laoo       f  j-i  i  o  i    t?cnniqiies»       It    is    especially    applicable    to 

implicit 


hich-lewel  proqr3m  variants  in  ><hich  the  Loops  oein'3  fu:;ed  are  implicit 
in  constructs  such  as  Sf?  c  -  r  or  m'?  r  s»  qiant  i  1 1 -^rs*  co^noouid  operators  etc* 
^nether  corn?rtion  between  Loop  fusion  and  formal  dif f erent ic t i on  is 
notea    in    CFa]. 


As    a    typical    exaJBole    or 
consider    the    follaKiTj    code: 

S    :=   o; 

(wh  ile    not     ^( J) ) 
X    :=    exp; 

s   w  i  th :=  x; 

end    while; 

T    :=  K( b) ; 


H?re    the     first     Loop    constructs    a    aet    o 
the       toLLowinq       stat^nent       computes       som; 
Which    may    reTJir?    sou?    itjratioris    over       S 


Loop      fusion      by      formal      di  f  f  erer.t  iat  ion» 


fo    give    b    mors    concr.-tti    ex^mplct    consider    tne    foLLowinq    prc^rau*     in 
which    we    want     to    build    up    a    m.ip    and    then    comoute    its     inverse    ma^: 

S    :  =    C>  ; 

(hhi  le    not    P(S)) 

cx ,    Y]    :=  cxp; 

3  ^ith;=  CXt   rj; 
end    while; 


T    :=   iz  ^t   bJ 


:  8 1    M    in   J  > ; 


To    fuse    the    two    Looos    toT-*th?r»     we     insert    commutations    of    T    intc    the  end 

of       the       white       Looo       JiJ     i i t i    iis    oreh?ader»    and t    afte*    ° L ia inat i ng  the 

origiral    computjtion    at    T    which    has    now       become       redundant?       obtain  the 
following    version: 


C  :-  {}  ; 
T  :  -  i}; 
(while  not 
CX,  YT 

S  with 
T  :  -  CIA, 
end  while; 


3  (  3 )  > 

:=  ?xp; 
=  lx,  y]; 


J  ii  3}; 
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rormaL    c  i  f  f  ert  nt  lat  ion    of    tli?    expression     for     T    KiLL    then    yieLd 
S    :=   {>; 
T    :-   {}; 

(whi  le    not    =>  (S)  ) 

CX,     YJ    :=    exp; 

s  wi  th  :=  :x ♦  yj ; 
T  wi  th:=  cr*  X]; 
end  whi Le ; 

in  which  fhe  required  Loop  fusion  is  accompL i shed. 

This  techni^jue  can  oe   jeneraLized   to  handLe   other   Loop   fusion 

patterns.     An   int::r?stin^   :  a  se   is  that  in   which   more   than   one 

computation  depends  on  a  set  (or  tupLs)  3.  Such  a  ;>rogram  fragment 
might  be  something  Like  the  foLLjwing: 

Ti  :=  Ki(S); 
T2  :=  K2(S) ; 

•   •   •   • 

Tn  :-  KnCS)  ; 

Suppose  now  that  3  ii  a  C3nstjnt»  or  a  set  read  oy  an  input  statement* 
In  such  cases  there  wiLL  be  no  jxpLicit  'first*  Loop  into  which  the 
c  onsput  a  t  i  ons  of  Tit  T2  ••  *  Tn  can  be  inserted.  Even  in  this  opparently 
unfa«crdbLe  case?  we  can  cr  :?  at  ^  a  Loop  which  oui  Lds  up  S  incr  e  iien  ta  LL  yf 
and  then  use  that  Looo  as  our  fusion  tariet  exactLy  as  before.  As  an 
exannrte-*    consider    t  h .'    faLLowim    pro"!  rami 


Tl     :=    ♦/    CX**2 
T2    Z=    */    CX»»3 


X 

in 

CI 

«     9     • 

M]]; 

< 

in 

Ll 

•     •    • 

Naj; 

This    code    can    be    traTifomeJ    a;    foLLows: 


S    :-    C]; 

T 1    :  =  T  2   :  =   0 ; 

( foraLL    A    in    CI    ... 

s  w  ith:=  a; 
Tl    :=  ♦/   cx**2   : 
T2    :=   */   :x»»3   : 
end    fcraLL; 


NJ) 
X 


in 

IT 


s]; 


(Note  that  renaming  of  aound  '/ariaPLes  Tiay  oe  required  ourinq  L'^oo 
fusion.)  ^ppLication  jf  ftrmaL  differentiation  to  the  expressicrs  for  Tl 
arc  T2  wiLL  then  yield 


s  :-  ci; 

7  1  :=  T.i    :=  o; 

(f oraLL  A  in  :  I 

s  w  i  t  h  :  =  A ; 
Tl  +:=  A**2; 
T2  *  :=  A*»3; 

end  f or  J  L  L  ; 


.  NJ  ) 


Finally*  noting  that  S  is  na w  dead  in  this  code*  we   can   eLimirate   it» 
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thereuy    accoup  L  i  5  h  1  n  3    th?    r?qj1'*e'j    Looj    fijsijn. 

/Snother  more  conijLex  but  stiLl  typicaL  case  is  that  in  which 
several  set-t  he3  rst  i  c  ?  x.t  e-i  3  ioTS  1  each  ri.?o?Tdir«  1  ot  pr?w1ousL>  computed 
expressions  folLow  each  oth?r.  Such  ca3?s  can  be  handlea  by  exactly  the 
^ame  techniqtie  as  abovej  that  i3t  by  f  j<?  inj  aLL  these  comput  at  ions  into 
a  first  Loop  (which*  as  in  th?  preceding  example*  may  have  to  be  created 
explicitly)  ano         then      ov       jooLying      formal      J  if terent i at i on       to       the 

expressions    in    qjjstiaT. 

fln  interesting  example  of  loop  fusion  us  in.3  formal  differentiation 
appears  in  the  construction  ot  a  jar bage- col lect ion  algorithm  due  to 
Cewar  and  fcCann  COM].  =»3rt  of  tne  transformational  derlwation  of  this 
alccrithm  is  reconstructed  below  to  demonstrate  our  Locp  fusion 
technique.  ror  3  refj-jiie  to  this  d?rivatior^«  see  LDSU].  A  very 
hich-le\/eL    specification    of    that    algorithm    r?ad'5    as    follows: 

assume  P  is  a  given  storage  map*  which  maos  each  storage  cell  to  a  tuple 
of  cell  pointers.  Each  cell  X  in  comain  P  designates  some  store^je  block 
anc  P(X)  is  a  list  of  all  cells  to  which  X  ooints.  Only  cells  hhich  can 
je  reached  frau  the  first  cell  2  arj  Jtill  active*  anj  these  should  be 
compacted    together*    with    oolnter    values    prcp?rly    adjusted. 


The       f  o  I  low  inq 
descrictiorl 


slightly      more      detailed       code      exoands      the         preceding 


J    steo    1:    find    all    cells    rescnaole    from 


{i.e«.    active    cells)? 


find    U     :    subset    d^m  a  f n    P    5 1     G     i  n    J    a  nd 

(forall    A    ii    J*    C    in    ^(A)    :    C    in    U)    and 
smallest(U*     inclusion); 

i    step    2:    comput?     t h?    new    Locations    of    active    cells 

IM    :=    CCB*    2    *■/    Iti^iZ)     :    C     in    U    3t    C    <    i]    J    :    8    iT    u> ; 

S    step    !:    compute    the    comoacted    "Storage    map 

Q     :=    {CiNJ(C)*    LN(0)     :    •)    in    P(C)J    J    -    C    in    J}'. 

»;    finally*    re-as5igT    i    ts     ti?    oriiitial    nap    r» 
p    :-   q; 

To  optimise  this*  we  first  solic  step  3  inti  two  suosteps*  cne  which 
only  comoutes  the  ran<^e  of  5.  and  another  which  computes  the  mac  Q 
itself.       This     leads    co    the    following    refinement: 

s    step    3.1: 

K    :=    ICC.    C\(a)     :    0    in    ^iZ)2    :    :    C     in    ui; 

«;    step   3.2: 


:-    -CrN(C)  ♦     K(C)  ] 


:    in   j>; 
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Next    we    f'jse    the    como  j  t  3t  1  on    of 
M  rs  t    expand:ia    iito    a    Laoji    a  »d 


K    with    the    computation   of      N-»       which 
so    oo  ta  i  n    th='     foLlowing    fragment: 


IS 


$    steps    2    and    3.1: 

N    :=   C> ; 

K     :=    CCC.    COM    :    0    in    "(C)]     ]    :    C    in    u>; 

(foraLL    3    in    U) 

T    :=    3    ♦/    C»P(C)     :    C    in    U    St    c    <    3]; 
NO)    :=   t; 

K    :=    CCC»    CN(0)     :    D    in    "(C)]    ]    :    C    in    u>; 
end    f  ora  I  L  ; 

Next  we  differentiate?  the  expression  for  K  within  the  foralL  loao? 
relative  to  the  augmentation  of  N.  To  do  so»  we  note  that  when  M  is 
augmented  by  the  assignment  'NO)  :=  T*  K  only  changes  at  points  C  such 
that  H  ?s  in  P(C)t  and  the  change  at  these  points  amounts  to  changing 
atL  components  of  K(C)»  «<ii;T  carresponj  to  components  of  P(C)  equal  to 
A  »  to  T»  This  calls  for  maincainin>j  a  •memo  map*  R  which  should  map 
each    6    in    domain    '    to    all    p-i  i  ps    lC»    I]    it    P(:)(I)     =    d    aid    C    in    L,.  This 

Leaas    to    the    follow  in<j    fragiiofit: 

$    st  eps    2    ana    J. 1 : 


N 

•    — 

{>; 

K 

•  — 

CCCt 

c 

] 

]   ; 

»         -^ 

R 

•  — 

•  — 

{CB, 

c 

Cf 

I  ] 

i  n 

] 

u, 

It    'J>  ; 


I     in    C  I 


»p(C) ]   st  pcc) (I)   =  R} ; 


( foraLL    3    in    U) 

T   :=  0   ♦/  :  uPiCi    : 
N(=?)    :=  t; 

(foraLL    CC»    I ]    in 

K(C) (1)    :=  r ; 

end     foraLL; 
end    forali; 


C    in    J    st    C 


;?  tS  }  ) 


13; 


REMAi^K:        Note 


the  geT?P3Lit<  of  the  Looj  fusion  techriiqje  exemplified  tiy 
the  atove  t  rans  f  omat  ion.  itanJard  techniques  mijht  try  to  iLse  these 
Locos  by  jsin.)  the  fact  that  aoth  iterate  o'/er  Ui  but  tnis  will  fail 
the  comoutatijns  rjqjircjf  \i  the  second  looo  for 
not  relatt'C  at  aLL  to  the  computations 
first     Looo. 


as 

loop  for  a  oarticuLar  C  in  U  are 
performed  for  the  same  C   in   the 


Next  we  apply  Loop  fusion  again»  this 
of  R       into   the   looo   como'jcing   U .    To 
comniitation   of   j   into   a   LooP»   usinj 
transitive  closure  scheme.   This  lives  the 


time  fusing   the   ccaputation 
this  end  we  first  expand  the 
a   standard   workse t-or ien ted 
following  fragment: 


s  step  1  uS  3  Looo: 
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u  :=   c>; 
u  ;  =  iu}; 

(wh  He  *  /:  {>) 

A  from  <j; 

u  w  i  t  h :  =  A ; 

W  ♦:=  CC  11  ^(!\)  ?t  :  notin  j>; 
end  white; 

5  comoutacion  of  R: 


c  11  a*  I  IT  :i  •••  !»5(C)3  st  pcc)(i>  =  a> ; 

Then»    fusing    the    Looos    toqethert     we    oota in 
J    step    1    and    computation   of    <l 

u   :=  c>; 
b    :=    {:>; 
R    :=   C>  ; 
(White    U    /=    C>) 

A    from    y; 

u   with :=   a; 

W    >:=    CC   ii    =>(*>    3t    C    notin    J>; 

R   :-  CCB,   CC,   r ]    ]   : 

C    IT    J,    I     in    :i    ...    »'(C)3    3t    P(C)(I)    =    B>; 

end    whi  te ; 


Next  the  expression  for  R  ii  j i f f erent ia ced.  This  is  easily  cone  and 
yields    the    fjlLowing    fra^neit: 

I    step    1     3rd    computation   of    d : 

u  :=  {>; 
u  :=  {C!>; 
R    :=  £} ; 

(wh  ile  U  /=  {}) 
A  from  U ; 
U  w  ith:=  M 
b  ♦:=  iC    in  P<A)  St  C  notin  U> ; 

R  >:=  tea,  c A,  I  ]  ]  : 

r  ii  :i  ...  t»^iA)j  st  ''(A)(1)  =  B}; 

enfl  whi  le? 

At  this  point*  a  new  looo  fjsion  >teo  becomes  aoplicaDlet  namely  we  can 
fuse  the  Loop  undatiny  R  with  tne  loop  updating  W.  To  see  this*  we  note 
that  toth  loops  depend  on  the  tjole  ri,,,4P(A)l.  Consequently  we  can 
create  an  auxiliary  looa  ^hos?  sole  ojroos?  i5  to  Duila  up  that  tuple; 
then  toth  computations  can  a-*  inserted  into  that  loop.  Alter  the 
required  clean-jDSf  w^  ootain  the  following  fragment; 

i  step  1  ^rd  computation  of  ^: 

u  :=  1} ; 
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.9    :-   {}; 

(While    W    /:    O) 

A    from    u; 

u  with :=  a; 

{ f oraL  L    I    ii    11    •.. 

c   :=  PCA) (I ) ; 


*JP(A)  ]) 


R    Mith:=    CCf 
If    :    njti 1    J 
W   w1th:  = 
end    if; 
end    foralL; 
end    whi  L  e  i 


CA,    111; 
t  ten 

c; 


CONCLLoION:  thr^e  Loop  fjsion  steos  suffice  to  procuce  this 
wersicn  of  the  algorithm  (still  not  its  final  version*  which  is  ootained 
oy      applying      additional       imorouing      transformations;  cf«         CDS'J]      for 

i-^tails)*       which       miiht      otherwise    hawe    jeen    considered    ingenicts    rather 
than    systematically    derivable. 


^,       FORMAL    DIFFIRZINJTIATIOiM    ANJ    THE    TNCREHlNFAL    GROWTH 
A     GIVtN    PREDICATE 


OF     SETS    SATISFYING 


In       t  h  is 
d 1 f f erent ia t i jn         can 
se t- t hecr e t ic    objects 
As       ooserved       in      e.q 
c 

0 


sectioT      we       mMI       describe      a       nay         in         which         fcrtnal 

Ji       ^jolied      to      control       the       nanner       in       which 

rj    constructed    from    qiiven    coarse      specifications. 

iShJt       a       common      and      useful    technique    for    the 

specification    is    to 

e 


^:>  \jij^f^t-j^\j  111  cvv^a  .tj.ijff  d  uijiiiiiiuM  aiivj  ua^iuiw      i.^«.iiiiiv^vi^        iv«i         '-iiv« 

constructicn  of  composite  oojects  satisfying  a  j i ven  specification  is  to 
ouild  them  incr^nentill/.  A  typical  exauale  of  such  a  process  is  the 
construction  of  a  suoset  S  of  some  univ/ersal  set  E  which  satisfies  a 
certain  predicate  '(S)«  Jiing  a  notation  suggested  in  CSh]«  we  write 
this  spec i f i c at i on  a? 


f  i  n  0  S 


suoset  £  st  P ( S)  ; 


This  can  je  realized  3/  j>iiq  the  folLowini  incremental  construction 
scheiie  (where*  as  loted  ejrlier*  arb*  denotes  a  nonde  te  rmi  nis  c  ic 
selection    of    an    element    from    j    set): 


S   :=   {}; 

(while  not  P(S) ) 
X  :  =  aro*  ( : 
s  w  ith:=   x; 

end    whi le ; 


); 


This    s  cheme    has       the 
exactly       nil       S!i3s?t: 


pro,>er  t  y 

S      of      ■: 


that       its      successful      executicrs       yield 
satisft'inq       P(3)    which    3  re    sequentially 
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Howc'-fep*     IT    3Pd?-    bo    p;fir»3       this       5Ch?u?       Ints       a      more       efficient 
algorithm*       it       is      of      crjcijL    importance    to    he    aolr?    to    select    the    ne«t 

•oetter*       ><ay»       either      by      making       its 


Ir  this  section  we  attempt  to  ■systematize  this  prccess  of 
refinement  of  the  search  far  3.  To  this  end  we  state  certain  netarules 
which  are  applicaole  for  3  rather  large  class  of  such  problems  anC  which 
show  how  to  refine  the  jrowth  of  S  in  a  way  which  is  oased  or  the  form 
of    P(S)    ana    which    or^sen/^s    ^Ijarithm    correctness. 


(*)        s    :=   c>; 

K'    :=  K( c>)  ; 

(while    K  •    /=    C>) 

X    :-    arn*    C    -    I) ; 

CK     :=    DK(S,    CO)  ; 

K»     :-    K»    syiB    DK  ; 

3    w  i thi=    x; 
end    whi  L  e  » 

As  a  concrete  examolef  consider  the  transitive  closure  example  examined 
in  section  j.  Its  next-to-Last  version  reads  (aft,?r  some  renaming  of 
variaoles)    as    fDlLows: 

s    :-  so; 

K     :-    ecu,    \I2     :    J    in    3t    7     in    Sc    st    V     in    F  C'J  >    >? 
(while    r<    /=    C>) 

X    :=    arb*    (£    -    3); 

K     :=    < 

-    ecu*    <]     :    IJ     in    3     3t    X     in     ri'J}} 

*    {CX,    V]    :     V     in    (Sc    Less    X)    st    V     in    F{:x}>; 

s  wi  th:=   x; 
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nonenoty 


>et »       this       is      not 
c o m me  r t    <a  t    the 


era    while; 
(Note    thJtt    b(,' cause    o    is    initidLi?ed    to    a 

exactly  in  instaac?  tt  (*)'.  see»  h3W^w^r»  a:i  extended 
enc  of  this  sfjction  concernin.i  this  deviation.)  In  this  example  a  bscter 
w.iy  to  choo«:e  K  is  to  insist  that  the  choice  jf  X  cause  elements  to  6s 
reitayt<zC  from  K»  i.e.  sel'^ct  X  for  wni ch  there  exists  U  in  S  st  X  in 
Moreover*  in  the  eomole  aefore  us  it  is  always  possible  to 
X  3S  Ijrij  aT  <  /-  Cy  (ii  fact  any  el?T!er»t  in  range  K  will 
This       refinea      selection       will      still       yield       the       smallest    set    S 


F{U>. 

select    such    ^n 

GO  ) 


GOJ.  ims       rexinea       selection       w 

satisfying    the    predicate    'K    =    C>». 

8s    aLreaoy    notc^    in    section     Z» 
selection     is    obvious    n eur i st ir al I y  : 
the    null    3et»    w?    ngy    33     <:;IL     att:*mot 
tiiTc    we    select    a    new    element     X    to    be 


the       rationale       for  such       improved 

Since    our    ]oal    is    to  reouce    K(3)    to 

to    remove      el3nent>  from       it       each 

aJd^d    Co    3. 


The  appl icao i I i t y  of  this  heuristic  can  be  ooserved  in  all  case 
stuaies  cunsiilered  so  far  ii  this  paper  and  in  uohj.  This  motivates  the 
tollcwinq  cefinition  which  caotures  and  Generalizes  the  phenomeron  noted 
aoovp : 

SiRIflL  SELECTABIlITY:  Ue  sav  that  the  equation  'KCS)  =  £} »  has  a 
serially  selectable  sJlJtin  (.or  equi/aleitly  that  K(S)  has  the  serial 
se I e c t abi  lity  property)  if  for  jach  i  suaset  Z  such  that  K(S)  =  i}  2nd 
such  that  S  is  mininal  ^ith  resoect  to  this  condition*  there  exists  an 
enumeration    Xl»««Xr»    jf     "^    suci    that    for    jlt    j     in    Ll»»«n] 

K(<:XU     ...*    Xj-i>)    noc     suoset    KCCXl,    ...»     Xj>) 

or*     ir    other    wordsj 

DKCtXlt     ...»    Xj-L}»     (.<]>}     *    K({:xi»     ...»     Xj-i>)     /=    O 


The     significance    of 
following    observation; 


s»«riaL       sel  set  aoi  I  i  t  y       is      manifestec 


1  n 


the 


CySc  "^VATIOK:  serial       >;Let  t  iji  I  i  ty       of       K(S)       implies       that  if         the 

{  none  1 1  eriti  ini  st  i  c  )  selection  of  X  in  the  aoove  scheme  (*)  is  restricted 
so  as  to  cause  elements  to  d?  removed  from  the  current  set  K'  (but  not 
further  '■estrictfi)  tT?ri  one  octains  a  scneme  wnich  is  equivalent  to 
sch-^ree  (*)  in  the  sense  that  it  also  constructs  all  minimal  subsf»ts  S  of 
^  satisfying  <(5)  =  {>.  It  oarticJlar,  if  there  exists  a  smallest 
subset  S  of  ►_  satisfying  ^(5)  -  O  then  this  S  will  also  be  computable 
by    the     following    mo  oi  tied    scheme: 


(•• )      s    :=   {>  ; 

K  •    :=><({>); 
(While    K  ♦    /=    i}) 

X    :-    ar\i*    {,J     in    £    -    3    st    DK(S»     CU}) 

CK    :=  CK( s»    cx}) ; 


K»    /-     CJ} 
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n  •     :  =    K  »    s  /  n     :3K  ; 

s   iji  th:-  x; 
end    whi  Le  ; 


W"?  wiLl  show  oelow  thit  the  familr  o^  set  exDr;ssion-j  K(S)  for  which 
•KCS)  -  {}•  hds  3  serlaLLy  ;^Lect33le  solution  is  fairly  Large*  dnd  h^pe 
that    further    stjdy    c  3n    ext»n1    t  h  i  :3     fimMy    stiLL    further, 

Seri-aL    se  Lee  tabi ».  i  ty    1i    a    consequence    of    the    foLLoijing    prcperty: 

1,'K^Ff  EMT/iL  Si'LECTA&I.ITir  :  A  sec-wdlued  expression  (<(S)  is  sale  to  h,3ve 
the  incroiTient  J  L  s  ?L  ec  t  3  jI  I  i  t  y  property  if  for  each  pair  S»  T  of  disjoint 
subsets    of    ~.    Mich    that    T    /=    O     in<i 

K(S)    n3t    sjoset:     <(S    *■    D 
there    exists    X    in    T    ojch    <:h3t 

K(3)    not    suoset    K(i    *    CX>) 

This     is    shown    oy    the    foLLowing 

FPOFCSITION    1:       Incremental    3  ?  L  ^c  t  a  t  i  L  it  y    i.TipLies    s-?ri3L    s  el  ec  t  ebi  L  it  y  . 

i'l'OOF  :  SupDose  that  <  has  the  incremental  se  lee  taoi  I  i  ty  property*  and 
let  cj  be  .i  ninimal  saas.^t  of  -;  sjtisfyin)  K(.Z)  -  O.  If  3  =  f}  then  the 
ecuaticn  K  -  C>  has  a  v/acuously  serijLly  ielectable  solution.  Ctherwise 
we    have    K{{>)     '-    O    and    tiie'-efor* 

K({>)    not    suDs?«-    KCO    ■••    5)     -     0 

so  chd^  by  increnentaL  j » L  ^c  t  33  i  L  !  t  /  th?r';  •nists  XI  \n    S  sucn  that 

K(C>)  nit  subset  K(<:xi>) 

iJe  can  continue  in  tiis  'n3m?-  t  i  L  L  all  ele.Tients  af  S  have  oeen 
selectee.  Indeed*  suppose  that  XifX2...Xj  hawe  already  beer  selected 
for    scnre    j<n.       riy    the    minimaLity    of    S    we    know    that 

K({X1.,.X7})     not    sui  S3t    K(i:xi...Xj>    +    ( '>    -    {Xi..-Xj>)) 
=    K (3)    -    C> 

and  by  the  in  c  r'?-n?nt  iL  3?  I  e,  t  ao  i  L  i  ty  orspert/  tT-'re  ^xijts  Xj+1  \n       S 
Cxi..,xj}  such  that 

K({XL...Xj})  not  suon?-:  <  (  t  XI  .  ..  X  j  *I  }  ) 

which    conduces    the    proo'i 

Q  «     c  •     'J  •' 


Next   wt:   stati    sufficient    conditions    for    the    incremental 
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selec  "tdui  L  i  t/    prorjerc/    t">    hiLi«       iupoos?    thi*     K  (  o )    h.is    the    form 
(1)  K(3)    -    Kl(S)     ♦    K21Z)     ^     ...     ♦    Krl'l) 

where    Kl    ...       Kr    ar^    J3t-/3Ljr?'i    oi.iaoiTjJ       hivinj       Ji^  joint       ranjes  ?      and 
where    each    Ki     can    oe    repres^nt-eJ    in    the    form 


(  2) 


KiC:^)     =    A1(3)     •     310 


where  /i  i  ( S )  i  "5  an  aroitrary  monotone  increasing  set-vaLued  expression  in 
Si  arc  where  6i(S)  is  an  aroicrary  monotone  decreasing  set-walued 
expression    in    3« 

(As    a    tyoicaL    exTmnLet    return       to       the       transitive      closure       scheme 
jescribed    above.       There    m  j    ha'/e 

K  ( S )     -    ( CIJ  ♦    V  3    ;    U    in     i  i    7     in    3  c    3 1    C  (J .    V  ]     in    F } 

=    (S    K    S:)     •    F    =    ^1-11:3]     •    ?2-lCi-l     »    F 

where  Pl»  P2  jre  the  projections  o  t  'i:  x  £  onto  Its  first  arc  second 
components       r  esp?  c  t  i  ^  i  L  ^.  Thij       exor3i;10T       K(j>    ^tas    the    fortn    ll)»    and 

Involves    3    slngl-*    term    hiv  i;i  3    the     form    (.2)    t^i  th 

A (3)  =  F   •  ?i-i:s] 

6(5)    =    P2-1C3C]         ) 

FHi-IOR-lM  ^'.  txoressiois  <i  >)  )f  th?  f^rn  (1)  ha/e  the  serial 
selec tafci L Ity  property  prjuided  that  for  each  i  <-  r  DB1(£«  CS )  is 
sub-distributive    In    the    argument    OS    for    OS    disjoint       from      S       (i.e.  if 

;3i(3)  is  d1  f  fer  ?nt  1  3 1  e  J  <ith  respect  ta  ^n  increasi  of  S).  Her?  1  a 
s'-t-vaLLiec  function  F(A)  of  a  set-waLued  variacLe  A  is  sale  tc  oe 
sub-cistricutive    If 

FCAl     +     fl2)     SJjSft     F<Al)     *     f-(A2> 

F>^CCF:  It  is  easily  seen  thJt  1t  suffices  to  prove  increnental 
selec  taol  11 1/  for  -in  3  j  oex  Dru-ss  i  on  (2)  of  K.  Apjlyln^;  our  formal 
c 1 f f e r ent ia 1 1  on    rules    to    such    a    suae xpress ion    Ki    we    ootain 

JK  1     =    Ai     *    DS1     sym    JA1     ♦     Hi     sym    DAI     ♦    0^1 

HowcVcr,  assuming  that  th  .*  chanye  in  S  relative  to  whicn  this  cerlvative 
i;  comDured  consis'-s  of  aiditlon  of  new  elements  (as  is  the  case  in 
scheme     (**))    a  r'J     usin;     trie    monotonicity    of    Ai     an  J    Bi»    we    qet 

Ai  ♦  JAi  =  {} 

CFi  sujset  61 

Hence*  usinq  the  assumotion  concernini  D -^  i  ^hich  .«as  nade  atovt  the 
u  xp  r  e  s  s  i  o  n 

^UZ,    J'^)     -    K1(S)     »     J<1(Si     "IS)     =    ;i(S)     •     J6  1(3*     OS) 
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is    s  Jb -d  is  tri ;?  ut  i  ve    witi    reso'ct     tc    the    3rgu,Ti:?nt     0:j  .       Tnat    is* 
f'i(3,     ri     ♦    T2)     iUJiv?t     »^i(S,     Tl)     ♦    Mi(S,     T?) 

Incremef»tiL  s-'LectaolLitv  jf  Ki(])  (jnd  i^'nc.'  Jf  K(o)  itself)  is  now 
easy  to  estajLish.  In1?^di  iuooose  tna*:  3«  r  jr?  Jisjoint  sutsets  of  Z 
3uch     that    T    /-    {>    anj 

Ki(J)    not    suos^t     \i(3    ♦    T) 
F'jt    :S    =     T  ;     it     foUows    that 

Mi(3i    T)     =    Ki  (3  )     *    lKi(3,    3i)    /=    {> 
lrut»     usinc    suo-di  st  ri  ou  ti  v  i  c  y  i 

Mi(Sf    T)     SJJS^t     ♦•/:     ^^(U»     £X})     :     <     in    Ti 

Hercc    there    exists    X    in    T    sjch       tnat       ,4i{3»tX})       /-       C}.  This       implies 

incr '^jment  d  I  3  el  ?c  t  33  i  I  i  t  (^  fir  Ki(j)  in  i  ojr  tnsoram  thi="n  follows  from 
prcpcsiticr    1. 

Jt.    £.    J. 


Let  l"SC  denote  the  class  of  all  monoton?  ■jxpression-;  B(S)  having 
the  orooerty  that  J3(S*  JS)  is  s  jo-d  i"?  t  r  ioj  t  iw  »*  in  T3  if  US  is  disjoint 
from  J.  Let  MSD*  denot*  thos^  expressions  in  'liO  wnich  am  monctone 
increasing*  and  l'?t  VI3")-  jonote  those  which  are  iionotone  decreasing. 
The  follOHinq  l^nna  iiJi:jt»s  tnit  *'SC-  is  i  fairly  larqe  family  of 
c^  xpr  ess  ions  : 

L£MMA    o:       f^SO*    M30>    an  J    ^^J-    h.ave    the    fallowing    pr  u  j  er  t  i  es;  : 

(a)     The     identity     function    -1(3)     -     >     is    in    MSO+-; 

(D)     If    '^{l)     is     in    '^32^     then    H3)c     is     in    i^SO-; 
if     *=(1)    i  ?     in    M3D-    tn -n     5(3)-:     is     in    ^S0+; 

(c)     If     ^(3)     i^    in    MS3«-     then    -C3(3>]    is    in    MS^<-    for    any    mao    F; 

(a)     If     E(S)     is     in    ?13  D-    then    F-1C^(3)J    is     in    M  30- ♦     for    any    single       valued 

tiac    F  ; 

(e)     If    dl(.3)»     H2<3)     a-?     in    M3:-,     then     ^1(3)     ♦     6^(3)     is     in     MSO-- 

If)    Let    PCXt    3)    oe    a    predicat:?    »<rtich    is    monotone    increasing    in       S«       i.e. 
whenever    3    suoset    T    then    ^(\»     3)      iniDlie;     r»(Xt    T)»       Sjppase    moreover    that 

0?(X»    5»    'J 3)    =    PCX,     3    *    a-.)     ara    not     PCX,    3) 

is  suu-li;  tri.)uti»/e  ii  33  fjr  33  Jisjaiit  frm  3*  i.e. 

OP(X»  3.  031  *■     332)  imjlies  CP(X,  3i  0.31)  or  DP(X*  3t  OSi> 
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Then     the     'unction 

B (S  J     =     iX     :    PCX.     3)} 

is     in    MSC*.      An    anaLojous    r^suLt    can    ae    stated    for      monotone       cecredsinj 
preai  c  3  te  ';« 

(g)     In    particular,    for    jny    rir-?dicate    Q(<.    r)     (which     is    inoepencent    of    S) 
we    hjwe 


El(S)    =    £X     :    exists    Y    in    3     3t    CI(X,     r)>  is    in    MSD* 


and 


OJCS)    =    C<     :     fJ-aLL    Y     ii    S     :     J(X»     Y)> 


i3     in    M^Q- 


PROOF:       Most    of    these     33S=»rtions    are    triv/idl.        To       prove       (c)»       we       note 
that     .^incp    n    is    monotjna    incr^a-^ing    Jd    ii    disjoint     froni   B.       Hence. 


CFCE]    =    PUB    +    JH]    -    FC  n    -    ,-Cu3]    -    =^11^1 

from    «hich    sub-d i s t r i 3 j t i y i t y     foLLowi    i mmed id t eLy . 
have 


To 


oroi/  e 


(e) 


we 


C(ei    *    b2)    =    OCl    *    5?  sym     il    •    032    sym    jBl    •    132 

-    DSl    ♦    :^2  ♦    BL     *    Cd2 

oecause  of  the  mono  ton  i  ci  i:  y  of  U  and  il»  iuo- J  is  tr  ioj  t  i  v  it  y 

o')  vi  ous  . 


is       then 


U  •       w  •       >J  • 


Rtf*ARKl  :LL  the  functions  K(3)  appearln.;  in  c<is;s  stuoipd  ir  earlier 
sections  of  this  note  and  in  i:3h]  satisfy  all  the  requirements  of 
Theorem  ?»  and  ss  lav?  ta?  serial  se  Lee  t  a  J  i  I  i  ty  oropert)^.  This  implies 
the  lecitimary  of  restrictions  imposed  in  tnese  cases  on  accition  of 
elements  to  3.  and  maker,  a  =;ijr)st  an  tia  I  3jrt  of  the  ar^^uraent  a  t  ion  that 
wouLa  other-.i3s  Ji  re^Jirea  t :)  justify  t.n  ose  t  ra  nslcrmat  ions 
unnecessary.  Here  we  can  make  the  general  comment  that  discovery  of 
metarjles.  such  as  the  ^el^ction  r^j  le  implied  oy  seriil  se  lectao  i  L  i  ty . 
cLways  represents  a  sicnificant  step  towaras  the  automat  i  ?  ct  i  or  at 
transformational  pro.jramminj  systems.  Such  metarules  are  also  useful  in 
manual       construction       Df       al.jorithmst         noth         for  jraving         aljorithm 

corrsctress     ind    select i on    of     the    transformations. 

A3  an  example  i  L  L  j  st  -  at  i  t^  the  t  rais  r  or  n  at  i  jf»s  whi:h  we  have  now 
justifiea»  consider  the  rolLowinc  algorithm  which  tries  to  fine  a  cycle 
S  in  c  Gi^en  jraph  b  (cf.  il^o  C3h]  for  a  more  detailed  study  of  this 
a  Ujo  r  i  t  hm  ) : 

s    :=   o ; 

(while    exists     <     It    5    iC     (fo'-alL    Y     in    S     :     <il)     /-    Yd)) 
or    3    =    C}) 
Z:=arb*(j-i); 

s   w  i  t  h :  =   z; 

end    whiiei 
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First  wc  Tiust  ori'ij  ♦:!?  a-^ficit'*  <3  0o<^3*in-i  ii  fch"?  <«niLe  stdtem^nt  to 
tne  carofiic3!.  Torm  K(^)  /-  O.  (In  v^h^t  follows  w^  will  icnore  Lhc 
sfOpredicjte  o  "  O  which  Jft-^ct^  th^  seljction  of  X  only  Ouring  the 
fir-^it    iteration    of     tfi?     Loop.)    To    co    this^    we    rewrite    the    predicate    as 

t;<     in    S     :     torall     r    in    3    :     X(2)     /=    Y(l)}    /=    t> 
which    can    be    transformeo    into 

CX     in    S    :     X<2)     utiT    f.X  ID 
anc    then     into 

S     •    {X     :    PZ(X)    notin    ^iCJ]}    /-    O 


r  IT   '!>  }    /=  C} 


^nere    PI  .ind  P2  are  tT=  oroK'-tiono  defined  3bo7_'.   Thii   allows   u; 
rewrite  the  predicate  as 


•ro 


where 


K(S)     /=     C} 


K(3)  =  s  •   (=»2- 1: 'i:  J]  1  )c 


K(S)  has  ihe  form  (i)  with  ^(3)  -  3  jnd  R(S)  =  ( P2- IC  PlCS  ]  3 )  c .  It 
follows  ^-asily  fron  _?Tim  3  thit  i(Z)  is  In  M33-.  Hjnce  K(S)  iias  the 
serial  se  L  ect  abi  I  i  t  y  prop.-'rt/,  which  alLows  us  to  write  the  loLlowinii 
version    of    the    preceding    iLjorithin: 

o    : =    {7  ; 

K  •    :=    o  ; 

(  .(h  ile    K  »    /=     O    or    S    ;     C}) 

Z     :  =    3ro  •     CW     in     3    -    3     s  t     oK(3,     i'A}  )     *    \(3)     /=    C}     >i 
K •     :=    K«     sym    OK (St     tZ}  )  ; 

s   with:=  z; 

e  nd     while; 

Howe>/er»     in    this    case    we    have 

DK(3»    fw>)     =    JS    •    (^^-iCPlLilJ)-: 

sym    S    •    P2-1C^^1l3    with    A2    -    PICS33 
sym    ns    *     P2-ILP1C3    with    W]    -    PLCS]] 


anc 


But 


CK{3,     CU})     •    K    =    3    *    P^-LCPIC:     with    Wl    -    -^ICSIJ 

=     CX     iT     J    :     X(2)     i.i    PiCS    -lith     J]    -    PIl3J> 


PICS    with    U]    -    PICS]    : 

if    PI(.-J)     in    '3i_[;:;j     ^^en    {>    else     fPl(W)}    end 


Hence 
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it  W(L)  in  CYvLJ 
e  L  <:  ?  C;<  i  :i  o 


:  y  in  S}  tnen  C" 
:  X  (  2  )  =  W  (  L  )  }  e  n  J 


Thusf  since  ^i  can  restrict  IK 
folLcvtina  werj^ion: 


*   K   to   Je   none!UDty»   we   obtain   the 


s    :=  {>  ; 

K •    :=   CI ;    - 

(white    K»    /=    {>    or    3    =    O) 

z:-3rn*rjiT    3-s    : 

U(i)     nocin    CY(1)     :     Y     in    Z}        jn-i 
exists    <     in    i     jt    )((2)     =    All)     >; 
CK    :=    if    Z(l)     in    ^Yd)     :    Y     in    2}    th?n    C> 
cjLs-     tX     in     5     :     X  ( -J )    =    Z(l)}    -^nJ; 

K*    :-   <»    o/n   D<; 
3   w  i  t  h :  =  z ; 

end    H  h \ L  e ; 

This  version  b;eL?:t3  it  ?Jg?  L  -Jhos:?  sojrc^  lude  is  a  tar. jet  nod?  jf 
sctie  ecge  in  S  but  not  J  so'jpce  rode  of  my  such  ^dge.  Note  that  che 
correctne'is  or  ttiis  s?Leccion  heuristic  is  J  format  consequence  of  our 
car.ercl  selection  rule*  ^hich  also  tiLLs  us  that  tiie  new  uersion  can 
reach  a  successful  terminition  if  and  onl/  if  the  preceding  version 
could. 

-^IMAI^K:        In    cert  1  in    ctsp';    K<S)     .nay    have    the    form    (1)       but       inwclv/e       also 

terrrs       Ki(?)       which    are    only    nonotone    increaiin*}     in    3.       '"' *"  ' *" 

then  oe  kept  -'moty  at  all  tifl;?s  jr  else  th"?  <hile  Laop 
will  never  ter;ninate.  iJe  can  then  use  these  terms  to 
the    selection    of    X     in     (»).       S  jec  i  f  ica  lly  t     sumos?    that 


These     terms    must 

in      s  cheme       (  * ) 

further    restrict 


K  (S  )    =    K0(-^  )     ♦    Kl  (  i) 

xhere    KG(^)    i>    mono  tone    iicreasing    in 
recuirements       of       Theorem       ^.  J  sing    v,._     .-^^v^ 

cnncernin'}     formal    d  i  f  f  er^ipt  i  a  t  i  in    of    or?dic3tes»       m 
■' •     ''*    to    the    following    variant    of    scheme    (*•): 


satisfies       the 


3    and    w  here       K  1  (3  ) 

results    developed    in    section    2 
can      then       convert 


th- 


scherre     (•) 


:-   O  ; 


Ki '    : - 
ass  ^  r  t 

(while 
X 


e  rd 


<  n  (  C  }  )    =    C  }  ; 
Kl'    /=    {>) 
-    aru*    CJ     i:i 
J  nj 

Kl»     :=    Kl •     iym 

3    w  i  t  h  :  =    X  ; 

while 


3-.    ;    <i(3)    •    :i)<iis, 

DKO  (3  ,      (.A}i     -     {}    >; 
1K1(3,     cxl); 


Cw})     f~    {} 


ke    now    return    to    a    more 
Assume       that       K(S)       nis       *".  h  ? 


3en**ral    discission      of 
serial       sel ect 3Di I i ty 


re-ccnsider    scheme     (*•).       Lit'^in 


formal       principles, 
orjperty     and    let    us 
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(3)  L(S)    -     CU    in     3c     :    K(S)     *     JK(St     CW> )     /-     O     } 

we    can    trjnsf'jrn     ich?n;    <♦♦)     iTto    the    fiLLoJin<.;    i/jrsion»    in 

ii    also    b^:in^    mjintalneo    incr'^m'ptaLLyJ 


which       L<j) 


s    :-.   i}; 

K  •    :=  K ({} ) ; 

L  •    :=  L ({>) ; 

(wh  i  Le    <  •    /=     O) 

X    :  =  1  -  D  *  L  • ; 

K  »     :=    K  »     sytn    DK  (  3, 
L*    :=    L*    sym    DLCS. 

s  >(  i  t  h :  =  X  ; 

end    while; 


cx>) ; 

cx>) ; 


If     UH   assume    tnat    tm    i?ri\/ativ;j    of    L(j)    cm    oe    exor; 


'Sse  d 


in    3 


which  Goes  not  depend  exoLicitly  on  K(S)  then  the  onLy  us<?  of  K«  in  this 
version  of  schetne  (*•)  is  to  control  the  while  Lood»  In  the  remaining 
part  of  this  "sectioT  we  will  consider  the  possiuility  of  e  li  mi  ra  t  ing  K» 
from  the  program  alto aether  oy  using  L(3)  uoth  in  the  selection  of  X  and 
in    controLlinq    termination    jf    the    while    lr)oo« 

An    ob\*ious    condition    that    wowld    permit    this    transformation     is: 

(-i  )  K(S)    =     O       if  ^       Lf  5)     =     O 

which  can  be  reformulated  as  follows  (note  that  by  definition  K(3)  =  {> 
always  imclies  L(S)  =  O) : 

UNCCNCIT  ICNAL  INCHEMENTAL  SI  LEC  T  A"?  ILI  TY:  K(3)  is  said  to  have  ^  he 
uncorc  i  t  ioral  incremental  se  lee  t  ab  i  I  i  ty  ;iron6rty  if  for  each  S  suose*:  E 
for  which  K(3)  /=  C>  tier?  exists  X  in  Sc  sjch  that 

KCS)  not  sjbset  K  (J  ♦  C<>> 

or  I  equ  i  va  len»-  ly 

K (S)  •  OK(S,  €<})/:  C> 

THEOFtf*  M  If  K(ci)  has  th  .'  unconditional  incremental  se  I  €  c  t  a  b  i  I  i  ty 
prooerty*    then    scheme    (**)     is    equivalent     to    the    folLowintj    scheneC 

( »* • )   c    :=   {} ; 

L  •    :=  L  ( c>) ; 

(while    L'     /-    f}) 
x    :=    aro*    L» ; 
L«     :=    L*    sym    DLi 

s  w  i  t  h :  =   X ; 

e na    while? 

foreoverf  if  scheme  (*♦*)  is  executed  with  arbitrary  but  deterministic 
selection  of  X  ti?!  it  al<<ays  terminates  and  produces  a  solution  of 
schetre     (**>. 
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pr^OOF  :      Scheme    (•*•)    is    >:>tjint?d    from   scheme  (•»)    by    reoLacIng    the       test 

»K(S)    /=    {}♦    •!  y    trie    test    'LCj)    /=    C>»    (which  is    equivdLent    since    we    hawe 

that       K(S)       hjs       the      unc  ond  i  t  i  onril  incrementaL      sel  ect  abi  Li  ty 

:Je3J      code  '^' *■ ■ -' 


property)       and       jy       e  L 1  ni  Ta":  i  ng       Jead      code.  Hence       tnese      schemes    ire 

equivaLent.  Our  second  j:jsertion  then  toLLows  from  the  fact  thct  every 
execution  of  (*»*)  must  t^rminatei  because  an  element  X  seLectec  from  L* 
is  immediately  rjTi3«/;j  frim  L»  ind  is  ri?ver  added  aacc  to  this  s.etf 
because    L'     is    disjoint     from    S    to    which    this    X    is    added. 


3.    E.    0. 


Next  we  give  a  simple  S'jfficient  condition  for   K(j)   to   have   the 
unconditional  iicremeTtal  s?  I  ec  t  jo  i  I  i  ty  orooerty: 

THEOFtM  5:  Suppose  that  X ( i )  is  a  set-valued  expression  in  3  which 
satisfies  the  requirements  of  Theorem  2  and  which  also  has  the  property 
that  for  each  i  <=  r  ■»!(£)  =  C>.  Th^n  K(3)  has  tie  uncoraitional 
incremental  selectability  prooerty. 

proof:  L<^t  S  be  a  sujset  of  Z  such  that  K(3)  /=  O-  Tiis  imolies  that 
there  exists  i  <=  r  such  that  Ki(S)  /=  C>.  As  in  the  proof  ot  Theorem 
2»  for  each  X  in  Sc  W3  obtain 

Ki(i)  ♦  CKi(S»  CX>)  =  Ai(3)  *  Qdi(S,  CX}) 

£ut  G  i  ( f. )  -  C}  jy  our  assjmation*  and  since  '.  i  i".  monotone  decreasing  in 
J    an<:i    CEi    is    suo -d  i  s  t -i  jj  t  i  /  ^    in     GS    we    JDtain 

{}     =    ai{E)     =    Bi(S    +    Sc)     =     di(S)     -    ::''i(St    Sc) 

T  hus 

3i(S)     =    08i(S»     5c)     id;JS-t 

♦  /    CD^KSt    tX>)     :     X     in    3cJ 

and    hence 


{}     /=    Ai{S)     •     H(S) 


suos 


^^v 


♦  /    :Ai(S)     •    D^iCSt    tXJ-)     :    X     in    Sc  J 
=    ^/    CKi(S)     *    3Ki(i,     CXJ-)     :     X     in    Sc  J 

Therefore    there    njst    ?xi3t     <     in     3c    sucn    tnat 

Ki{3)     •     DKi(S.     CX})     /-     C> 
which    implies    that 

K(S)     *     DK{3.     {<  > )     f-    C> 
and    thus    prov:?s    ojr    ti?3r?ii. 


Q.  :.  0. 
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PL.'^'Vi'K:  Exorf?s3  1  ons  K(3>  -litiifying  th^  requirements  of  Theorein  5 
hdve  the  prooerty  K(C>  -  {} ,  i.e.  the  universal  set  f  is  a  sclution  to 
our  prccLeiT!.  It  is  noteworth/  that  j  conver^^e  statement  can  also  be 
formuLate^t  js  f^lLo^5:  jjjoase  that  K{  :)  satisfies  thi  requirement:;  of 
Tneorsn-    2    anci    that    K(c)    -    <!>  ,       This    impLieSf     tor    each    i    <-    r» 

Ai  (D  *  Qi(£)  =  O 
^ no    since    fii     is    monotone    incrjasing*     it     fjLLows    that    tor    each    S    subset    Z 

Ai (S)  »  Bi (£)  -  C> 
«r?    can    thfrrefore    rewrite    ^ach    sub  sxpr-jss  ion    Ki(3)    as 

Ki(S)     =    Ai(3)     •     (3i(S)     -    di(E)) 

and    so    obtain    a    representation    for    KiS)    whicn    satisfies    the    r ecu i rements 

of    Thfore.-n    t. 

The  <5igTificdric?  ot  Thiorem  i  is  rather  Limited  in  the  general 
C3se»  because  when  it  applies  we  alrearJy  know  one  soluticn  to  our 
;jroolem  (namely  -:)i  iid  ii  is  ooiitless  to  iooly  schjne  (•♦*>  to  ootain 
another  scl'Jtion.  However*  if  we  wish  to  comoute  a  rairimal  <  or 
smallest)  solution  of  the  equation  K(:3)  -  £}  then  even  though  Z  is  known 
to  oe  a  solution  we  woul-J  like  to  apply  scheme  (•»*)  to  obtcin  those 
(tiPiTal    solutions.  Theorem       ^        then       rjises       the       following       important 

proul.^m:  Jo  all  e<?cjtioi;  of  scheme  (••**)  yiela  minimal  solutions  of 
the  ecuaticn  K(S)  =  C> ?  This  question  is  siqnificant  when  an  original 
snec i f i ca t ion  asks  for  minimal  solutions*  and  if  its  answer  is  positive 
we    c.  .^n    use    a     3et  :?rm  i  n  i  s  t  i  :    /ersion    of     (•»*)     to    s  j  I  ve     th?    proolfn. 

While  in  general  this  oroperty  neeii  not  hold  (see  belok  for  an 
example)*  we  will  giv?  5  s  i  i  :>  1 2  sviffici^nt  conaiciun  that  guarantees  it. 
It  is  hoprc  that  simicar  conditions  can  ce  derived  so  >s  to  exteno  che 
applicability  of  the  deterministic  scheme  (•*•)  to  computation  of 
minimal  solutioi^  of  K('5)  =  {}»  as  this  seems  to  be  the  best  iffprowement 
in    algorithm    efficiency    that    our    tcrmalism    was    aole    to    attain    sc    far, 

THEOREM    S:       (a)     Ass'im?     that    L(3)     has    th?    nra-)erty    that    the     function 

f^lS)     =    S,    *    US) 

is    monotone    incr?asiT]     i  »       J.  Then*       if       K(  3)       has       trie       unconditional 

incremental  sel ect abi I  it y  property*  toe  equation  K(S)  -  (>  has  a 
smallest    solution    which    will    i>e    oroduced    by    any    deterministic       execution 

(0)    fcreouer,    N(S)    will    lie    monotone    incre.isini    if    the    subexpression 

Cw    ;     K(^)     •    0K(:,    fJ>)     /=    {}    } 

is  monotone  increasing  in  3.  rurthermore.  this  last  condition  itus  t  hold 
if  K(S)  has  the  forfl  (i)  aid  if  in  jiaitioi  OU  5  is  independent  of  3  for 
each     i    <=    r. 
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rnCOP:       The    e'xiitenc?    of     i    sm.iLLost    solution    of    KCS)     =    C>    follcws       ny       a 
:,tandard       fixooint       arqjm.?n:  •       Indae'it    if    one    defines    a    sequence    of    sets 


SI    -    O 

S  j  >  1    =    S  j     «•    L  (  i  )  )  ♦ 


=     1 


then  this  sequence  must  converse  to  a  set  S)  which  is  the  smallest 
solution  of  K(3)  -  {>•  J^xt  consider  any  deterministic  execution  of 
scheme  («•*),  and  suddos;  that  th?  elements  Xlt  X2  «.«  Xn  have  oeen 
selected  from  L»  in  orJer*  so  that  3  =  CXi...Xn>  Is  a  soLuticn  of  the 
equation  L(S)  =  £>  (and  hence  also  of  the  equation  K(S)  =  {>).  :^y  our 
a  ssumpt  ion  » 


XI  in  C>  *  H<:})       S'ldS'^t   3 

so  chat 

{Xl>      subset       "nj. 
cut     this    imclies    that 

{Xl>    *    L(CX1})       sjo^et       3] 


}     ♦    L  (  S  ■  ) 


sa 


which     implies    that    X2 »    o^inj     an     element    of    L({X1>)    must      belonc 
Hence    we    have 


to 


{XI,    X2>       subset       S„ 

ana    continuing    in    this    manner    wt;    can    show    that    S    subset    SC  »       anc       sj 
the     itirimality    of    30    we    concljde    tnat    3    -    SO.       since    om    always    has 


N(S)     =    S    ♦    CA 


,<(5)     •     JKCJt     U})     /-     c>     > 


by 


we       concLuCe       Immediately  that       the      monotonicity       or      the  seconc      set 

exore'ision       i  ■?       sufficient  to    guarantee    the    monotonicity    of  N(S)     itself. 

Finally!    jupoose    that     K(3)  las    the    form    assumed     in    the    last  assertion    of 
the     t  heorenr  .       Then 

iU     :     K(S)     •     D(<(3,     i-t})      /r     C>     >     = 

♦  /    C    iA    :    Ai(:^)     •    J^iCCi«})    /=    O    }     :     i     in    Ci..r]    ] 
-    +/    :     m-i:M(S>3    :      l     in    Cl..r]    1 

which     Is    oCwiousLy    monotone    incr-jasinsj    in    S. 

J  .    E  •    J  . 


Ihaorems  ^t  o  and  a  thjs  allow  us  to  use  deterministic  workset 
alqorithms  to  solvf?  a  fairly  large  class  of  subset  construction 
pr on  L  ^ms  . 

/is  an  example,  consider  th?  transitive  closure  icheme  nentloned 
earlier.       For    this    scT'ue    -i^    hai/e 


PA 


l3C 


anc     it     toLLowG    easily     iron    >_ 
c  (  S  )        of       K  (  ;  )      is     in    H  S  0-  . 
property!     which    alLaj;     Js    t>     js^ 
since       r(=:)        -       C}»        it        roLLovjs 


unc  onJ  ir  i  onaL     inc  rem;?  n  t  aL     >  •  L  ^c^  ao  i  li  ty    proo'^rty* 
scheme     (♦**)    instsjj    >f    s;h.*ni     (**)»      Moreover, 


>_iiTima     3    thjt    tiie    monotone       aecreasirc       factor 

H-jnce    KID    h3~    rhe    incrementaL    se  L  e  c  t  a  b  i  L  i  ty 

-.  ch-»m?     (*♦)     to    soLi/e     tr-ifs    orooUm.       ^ut 

from       Theorem    3    that    KCj)    alsc    has    the 

^hich    allowj    ts    to    use 


Ct-tS*    03)    =    P2-1C'JS] 


13     inder)endenc    af 


3    1 1  at     ay    Theor^fl    6    we     know    that       there       exists 


13  inderjendenc  af  S»  33  1 1  at  ay  iheorefl  fa  we  know  that  There  exists  a 
straLl'Jst  solution  to  our  orooL.fm»  and  that  any  deterministic  execution 
of     (*•»)     ^ilL     yield    this       soL.ition.         To       ootjiT       sjch      a      deterministic 

al<]orithn»    we    write    H  Z  t    as    follows: 


LCS)     = 


=     3c 


fw   :    K(  j)    •   aK(  J.   Cij>)    /=   {}> 


{.'4    :     F    "    ?1-ILS}    *    P2-LCC^}1    /-    O     } 


-    Sc     *     02:  F    *     '1-IL3]  J 
=    Sc     *    FC3] 
iNext     we    compute    OL I 

CL( :.    Cx  >)    = 

{X>     »   FCS3  (suaset    of   L) 

*     C-tCX}]    -    F:3J)     •  (5c     '    {X})  (disjoint     from    L) 

=    CX>  (subsetof-) 

■►    rC  CX>  ]    *    (Sc    -    L)  (disjoint     from    L) 

-J?    thus    obtain    t  n  ?       rjllo^iii       w?ll      known       ,<orc  ae  t-ori  j  nt  ed       transitive 
closure    alcorithm: 


s    : 

L  • 


■  30 ; 
:=    Cw 


in    iC 


(while    L«     /= 

X    :-    arb 
L  •     :  =    L  • 

*  Cir 

S    Mith:= 
end    while; 


U     in     3    st     CU»     '^1     in    ri; 


C>) 

L' ; 

l?5S     X 

ii     FCX} 

x; 


:    Y    Totin     i    and    Y    no  tin    L'>» 


note:  /»s  a  matter  of  fact»  this  transitive  closure  algorithm  coes  not 
have  exac'-ly  the  form  (*•*)»  uecjuse  it  initializes  3  to  a  noneitoty  set. 
It  is  irteresfinq  to  not-  that  this  initialization  can  also  be  derived 
from       our       formal      princiol-s,  Ird^edi       a       direct       translaticr       fron    a 

spec  i  fica  f  ion    of     the    !:P3n;ici/e    closure       prioleo      yieldi       the       foLLowin'j 
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schenet  which  has  th^  form  (»)  (and  4r>3r:i  th?  minifnaLity  concition  Is 
i  crcr  ec) )  : 

s    :=  {} ; 

(while     (SO     *    Sc    ■»■    F     »    >^L-LCS]    *    P2-lCSc])    /=    C}) 

X    :-    arb*    Sc; 

s  ^  1 1  h    :  =   < ; 
ere    white; 

For    this    scheme    ■<?    ha/? 

K(S)     =    SO*Sc«-F»    P1-IC.-5]    *    P2-ICSC] 

wh^c^  has  the  for,Tj  (1)  but  in^/oLves  two  terms,  ooth  invoLving  monocone 
jHcrejsincj  factors  j?L3iiiiq  ty  MSJ-.  Hence  K(S)  has  the  serial 
se I e c t at i L i ty  propert/.  Moroower»  it  follows  from  Theorem  5  that  K(S) 
has  also  the  uncon J i t i ona I  incremental  se lee taoi  li t y  propertyt  and  K(S) 
is  also  easily  seei  tj  satisfy  the  req  ui  reme  i  ts  or  Theorem  6«  Ihus»  to 
obtain  a  deterministic  version  of  scheme  (♦**)  for  this  prcolemi  ne 
compute    L(S)     to    ootaii: 

L (S  )    =    Sc    •    SC    ♦    3c     »    FCS 1 

Then    we    compjte    0L»    oitaiiiij 


DL(S»     CX>)     =     3(ic    ♦     m     *    FLS2}) 

=    CX>  (subset    of    LC:)) 

*     FCCXJJ    -    S    -    L  (iisjoiit     from    L(S)) 

This     yields    the    followin<3    transitive    closure    aLvjorithmt 

S    :-   c>; 
L*    :=  sj ; 

(while    L»    /=    t>) 


X  : =  3P0   L 


•  : 


L»     Z-    L»     less    < 

*   Cr    ii    Fi<} 
s   with:-   x; 
end    while; 


r    lotin    3    and    if    notin    L«>; 


This     last    algorithm    is    in    fjct    more       elejant       than       the      prececing      onet 
since    it    simolifies    tie    initialization    of    L'. 

4s  another  inttrrestiii  application  or  our  formal  principles* 
consicer  the  eauivalence  relation  proolem  given  in  section  2.  There  we 
have 

K(5)  =  A  •  sc   ♦•  =5  *  So   ♦   5   *  i-msc: 

♦    --ILS]     •    "J-lCS:     *    H-lCScJ 


where  the  functins  I»  F>  G«  H  ar<i  as  Jefined  in  section  2.  K  (S ) 
ccuiousLy  satisfies  the  r e lu ir emen t s  of  Theorem  2  ana  so  has  t te  serial 
selec  tabi  I  i  ty  property.  >«oreover  it  also  satisfies  the  requ  i  rentents  oi 
fneorems    5    ani    -j  »    so    tnit    w'    can    ootain    the    smallest    solution    c1     •K(3)    = 


P/lGE    3* 


{}•  o>  th^  ds  t  ri  rm  in  is  t  ir  version  jf  scnem?  (*•*)«  To  jchievt;  this*  ws 
first    ccmyute 

K(S)     •     DK(S.     Cj})     = 

(A     ♦     H)     ♦     CJ}     - 

s  *   i-iccu}  1  * 

F-l[3J     *     G-i;3]     *     H-1!:CJ>J 

Hence  » 

L(S)    =    <U    in    Sc     :    U     in     (A    ♦    B)    jr    U    in     ICSJ    or 

J     in    HLr-lC3  3     »    3- ICSJ]     } 

=     5c     •     (A    ♦    '^     ••    IC3]     +    HCF-LC3]     *     3-LC:>]]) 

IM":?  X  t  »    we    comout?     DL(r>t    C:<  >  )  ♦     issuminj    that    X     is    in    L(3): 

DL(3»     CX>)     -     CO  (subset    of    L> 

♦     (Sc    -     CX>)     "     0(A     «•    B     >    ICn     «•     HCr-lCSJ     »    ^-ICG]]) 

(disjoint     from    L) 

/SLthauch  the  ruLe  tor  di  f  fer -^nt  i  Jt  in  q  3  (  non  J  i  s  j  o  i  nt  )  union  (rule  (3)  of 
sectior  ^)  is  somewhat  camDlicated  we  can  ^limpLify  it  consiceraoLy  in 
the  examoLe  jefir?  J5«  t)  t  i  i  j  t  n  i  *:  all  the  suoexpres  s  i  ois  At  J»  ICa]  and 
HCr-lLS]  •  G-1CS3]  3r?  monotone  incpjasin^  in  S.  Ic  is  thsn  easy  to 
show    that 

C(A    4    ^     ♦■    IC3]    ♦    HC--LCS]     »     J-LCni)     = 

C  A    +    D  H    ♦    0(1131)     >    J  (  HC  F  -  iL  3  ]     •     3  -  1 C  3  J  J  ) 
-     (A     *    '?.     >    1121    *    HCF-1l3]     *     3-lCS]]) 


'ut 


CA     :     CS     =     C} 

cdcsj)   =  i:C)(>]  -  iCi  J 

C(HCF-1CS3     *    G-lCSJl)     = 

HC0(F-I;3J    •     3-LC3])]     -    HCr-LlJ]    •     3-11:3]] 

=    HCF-ICCX}]     •    G-tC3JJ    *     HCF-ICSJ     *    3-1lCX}]] 
*    HCi^-lCCX}]     ♦    3-lCCX}:]    -    HC^-ICS]     •    3-lCS]] 

ALL    this     impLies 

CL(7«     CX})     =     CX} 

♦•    dlCx}]     -    rl[:--lCCX>]    *    G-LC5]]    * 

HCF-1C3]    »    G-1L{X>]]    -■    HCF-ICCX}J     *    3-LCCX}:: 
-    L  {  S )     -     3  ) 

Then  f     it    »j  e    L^t     X    -    IJ»    Jl     ill     J  5  ?     th^    J-*finitions    of     the       functions       F» 
Cf    H    dnc     If    we    ojtaini     after    a     few    sifTioLificitions 


OLCt    CX>)     =    Cxh 


(  3  J  a  5  e  t    .» f    i. ) 
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oy 


^     (C:;.t    Jl}     *■    iZ't  f    LI    .    CW,    Z]     in    S} 
>    Crz»     ;JJ     :    CZt     V]    in    S}    -    L(-":)    -    S) 
(disjoint    from    ■_) 

Hance    *ic    can    soLv?    trie    ^qu  iw  j  lenc :?    relation       prajLem 
ceterTirijtic    aL^orithm: 

S    :=    t>; 

L  •    :  =   A   ♦   s ;     - 

(wh  ile    L •    /=    C}) 

Cv.    >j]   :=   dro  L'; 

I'     :=    L»    L?ss    CJ«     W] 

*    (CCW.    v:i>    ♦    (.L\l^     I J    :    C'.J,    Zl     in    3> 


the       1o  L  Low  ing 


>  cczf   wj 
3  .<  i  t  h  :  =  : ; ,   w  J ; 


;■  /, 


V  ]     in    S>     -    L  •     - 


>; 


ena    while! 


This  version  cai  je  rjrtT^r  jjciTiir?d  ?.j.  ay  fljlitiining  the  inverse 
SINV  cf  3  also  3o  that  thj  Sf* tf omsrs  in>/olv?d  In  the  updatinq  cf  L*  r.an 
lie  cheaply  const  rue  te  J .  \)^verth  eless  »  a  conoarison  of  the  Last  version 
with  the  more  cumoprsofue  lane  nondet  ■ermin  ist  i  c)  aljorithm  ctr1w«d  in 
section  2t  and  the  fact  that  the  Last  version  has  oeen  obtainec  froir  trhe 
ordjL?m  ^pec  i  f  i  :  a  t  i  3 1  ii  a  3i'*?ly  tomal  mann-^-*  clearly  show  the  ireat 
potcrtial    cf    our     t  orma  I  itim. 

Finally    we     ]  1  v/ ?    31    ^on-jle  to    wn  i  c  h    Theorem"?    5    and    6    do    net       apply. 

For    this    consider    the    follow  in^g  simale    prooLem:       Given    a    relacicn    H    on    £ 

<  F»  find  a  Tiiniual  Jias?!:  3  jf  ~  s ach  that  RCS]  -  F.  It  is  easily  seen 
that    in    this    example    we   have 

K(S)     =    :^C;>]c 

which  obviously  satisfies  the  requirements  or  Tneorem  2.  How€>ier»  for 
TheortfT  -i  to  apoly»  we  must  hav/e  •iLZl  -  F  (which*  in  this  excrtiple»  is 
also  a  neces^iry  conciitiai  tor  K  to  ha^/J  ^.hi  jtc  and  i  t  i  ana  I  incremental 
se  I  £ c ta t i  1 1 1/       property).  Thus.       unless      this    condition    is    met*    scheme 

(***)  is  not  eqjivalent  to  scheme  (»*).  "or^over*  even  if  RCF]  =  F*  in 
which  case  a  decerniiiitis  /;rsio-i  if  scheme  (*»•)  can  tc  used  to 
coitqute  a  solution  S  to  the  equation  K(3)  =  C}»  there  is  no  cuarantee 
tnat  this  soLatian  ^ilL  a,'  siTinjl,  To  see  thi^?  Let  E  =  F  =  fit?!!  and 
l-t 


K  =  {CI ,   11  f   L :.    u.   :  e »   ?.  ]>    . 

It  is  eas/  to  check  that  fo'"  this  example  we  ha«/e 

L  (  S  )  =    'ic    »  R  - 1  I  ■(  :  S  J  c  J 

so  that  i  in  L(C>)  3n^  2  in  L({i})f  which  implies  that  the  ncnminimal 
solution  S  -  Cl»  2}  zit  j:  latained  ay  some  le c erm in  is t i c  execution  a* 
schenf  (**•)»  which  will  first  put  1  an-i     then  2  into  S. 

In  cases  where  tijre  e<i5ts   a   su3llest   iolation   to   K(G)   =  ii 
Theorerr   ,-  'jiwe'^  a  sufficient  condition  for  that  solution  to  oe  oroduced 


jy 
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any     1p  •■eri' i  ni  s  ti  c    2xe:ijti  jn    of     sc  n  sm  j     (*»•).       In       jther       coses      wh^rs 


such  a  jrraLLsst  soLution  does  not  exist*  Jut  where  the  spec  i  f  1  cat  »on 
jsk.3  neve'-th?  les  5  t3-  ?  niniiijL  siLutiiii  4j  Jo  not  h3V2  as  yet  a 
similjr  ccndition  that  ^vouLi  vjuarant^e  that  any  soLjtion  proaucea  by 
ce  t  er  (T,  in  i -.  t  ic    execution    of     (  ♦  ♦*  )     is    miniinal.  This       oroperty       has       been 

observeci  however*  in  most  cjses  studied  so  far,  anJ  i^e  conjecture  that 
.3  reUitively  simoLe  condi*-ion  impLyinq  that  mininjdlity  oroperty  car  be 
<;  t  a  t  ec. 


even    if    KIZ)    do?3    not    iatiify    0)»    but    a'?    Lonq    an    it    stiLl    has       the 


serial       seLec  t  ao  i  L  i  t^       propir^'yt     it    remains    DOSsioLi;    to    use    scheme 


to    ccrstruct    a    subset     3    satisfying    K(j)    =    {}» 
indicated    by    the    foLLo«in_)    oroposition; 


but     in    the    narrower 


sense 


PRCFGSITIQN  7:  Suppose  that  K(l)  has  tn?  seriaL  sel ectabi Li t y  property. 
Then  any  minimal  sjoset  3  satisfying  .<(3)  =  €>  can  be  computed  by  (the 
nonoe  termi  ni :,  t  ic )  scnii?  <*♦*)»  out  there  Tiiy  e<ist  exs;ut!ons  of  (»•«) 
which    produce    subsets    3    that     io    not    satisfy    the    equation    K(S)     =    {}• 


P^OOF:       L'-t    S    DP     3    TiTinal    5J09?t    of     ^    jatisfyii,       KC3)       =      O  .  Serial 

s^  I  e  c  t  at  i  I  i  ty  for  K  tii  ?n  imolies  that  3  can  oe  constructed  fcy  scheme 
(•*)    usinn    a    seauenc?    of    selections    during    ^hich     C^)    holds. 

scherne       (**♦)       is    ex:;:ut:?J    jsim    the    sane    sequence    of    selec_ 

also  yiela  the  set  3.  Ho^^eve-  ther:;  may  exist  other  executions  of  (*••) 
for  which  (4)  do^s  lot  hold»  and  jitc?  eytiry  ex.'Cjtion  of  (***)  is 
successful  (s=?e  tne  proof  of  Theorem  h),  there  may  exist  executions  of 
(•♦*>    producing    sets    Z    v»hici    ao    not    satisfy    <(S)    -    C>. 


Hence*       if 
if    se  le  ct  ions     it    will 
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